-- Logs begin at Tue 2022-05-24 13:11:55 UTC, end at Tue 2022-05-24 14:21:27 UTC. -- May 24 13:46:29.134929 dv-cinder-842129-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 13:46:29.142935 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 13:46:29 2022] *** May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: nodename: dv-cinder-842129-1-iscsi May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: machine: x86_64 May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: clock source: unix May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: pcre jit disabled May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: detected number of CPU cores: 4 May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: current working directory: / May 24 13:46:29.144962 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: detected binary path: /usr/bin/uwsgi-core May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: your processes number limit is 47680 May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: your memory page size is 4096 bytes May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: detected max file descriptor number: 2048 May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: lock engine: pthread robust mutexes May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: thunder lock: enabled May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 13:46:29.145716 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 13:46:29.190169 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: Python main interpreter initialized at 0x5639de4929c0 May 24 13:46:29.190169 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: python threads support enabled May 24 13:46:29.190169 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: your server socket listen backlog is limited to 100 connections May 24 13:46:29.190169 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: your mercy for graceful operations on workers is 90 seconds May 24 13:46:29.190502 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: mapped 403077 bytes (393 KB) for 2 cores May 24 13:46:29.190576 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: *** Operational MODE: preforking *** May 24 13:46:29.190813 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: *** uWSGI is running in multiple interpreter mode *** May 24 13:46:29.190813 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: spawned uWSGI master process (pid: 103068) May 24 13:46:29.190995 dv-cinder-842129-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 13:46:29.194820 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: spawned uWSGI worker 1 (pid: 103069, cores: 1) May 24 13:46:29.194820 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: spawned uWSGI worker 2 (pid: 103070, cores: 1) May 24 13:46:29.194820 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 13:46:30.400688 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 13:46:30.477571 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 13:46:31.153436 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:46:31.153436 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: from cryptography.utils import int_from_bytes May 24 13:46:31.153749 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:46:31.153749 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: from cryptography.utils import int_from_bytes May 24 13:46:31.281758 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:46:31.281758 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: from cryptography.utils import int_from_bytes May 24 13:46:31.282099 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:46:31.282099 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: from cryptography.utils import int_from_bytes May 24 13:46:33.793160 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 13:46:33.793810 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 13:46:33.793917 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 13:46:33.794192 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 13:46:33.794445 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 13:46:33.794830 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.795154 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.795473 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.795705 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 13:46:33.796110 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.796203 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 13:46:33.796284 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.796499 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.796596 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 13:46:33.796816 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.796911 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 13:46:33.797105 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 13:46:33.797216 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.797448 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.797549 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.797703 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.797797 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798017 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798117 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798340 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842129-1-iscsi {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798435 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798659 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798755 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.798964 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.799068 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.799274 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.799366 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.799590 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.799682 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.799918 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.800019 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.800214 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.800306 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.800532 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.800628 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.800856 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842129-1-iscsi {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.801020 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.801179 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.802349 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.802498 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.802643 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.802777 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.802903 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803033 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803033 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803276 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803414 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803538 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803662 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803808 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.803808 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804091 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804313 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804452 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804586 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804724 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804724 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.804978 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805110 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805231 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842129-1-iscsi {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805487 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805612 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805764 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.805896 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806029 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806166 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806300 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806432 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806675 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806805 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.806929 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807066 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842129-1-iscsi {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807196 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807339 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807510 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807653 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807844 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.807976 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.808165 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.808316 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.808483 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.808621 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.808800 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.808936 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.809118 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.809256 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.809418 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.809553 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.809723 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.809858 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810029 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810167 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810344 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810479 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810646 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810775 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.810947 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811089 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811214 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811338 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811487 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811621 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811805 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.811970 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812143 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812272 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812461 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812600 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812737 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812869 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.812995 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813127 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813259 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813397 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813549 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813687 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813855 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.813990 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.814158 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.814299 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.814460 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.814600 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.814726 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.814856 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815008 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815324 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815460 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815627 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815759 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.815938 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816080 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816248 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816374 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816554 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816688 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816859 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.816994 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.817162 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.817299 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.817464 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.817596 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.817770 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.817904 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.818085 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.818222 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.818385 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.818520 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.818704 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.818836 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.819009 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.819144 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.819315 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.820076 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.820262 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.820412 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.820539 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.820810 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.820937 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.821130 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.821268 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.821439 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.821569 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.821745 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.821878 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822061 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822195 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822376 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822504 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822680 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822815 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.822940 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823064 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823216 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823351 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823517 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823655 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823848 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.823991 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.824155 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.824284 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.824431 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.824567 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.824732 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.824861 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825031 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825158 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825333 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825471 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825634 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825762 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.825935 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826073 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826236 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826372 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826536 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826663 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826834 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.826969 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.827139 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.827277 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.827441 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.827568 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.827740 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.827880 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828067 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828194 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828369 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828497 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828671 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828799 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.828973 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.829099 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.829272 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.829475 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.829611 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.829744 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.829878 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830011 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830163 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830299 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830463 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830590 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830767 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.830898 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831070 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831199 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831371 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831498 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831676 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831804 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.831995 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.832118 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.832291 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.832421 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.832599 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.832733 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.832894 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833028 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833197 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833331 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833498 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833632 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833795 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.833929 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834095 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834392 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834518 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834690 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834818 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.834997 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.835697 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.835853 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.836120 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.836261 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.836441 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.836568 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.836745 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.836882 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837054 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837183 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837358 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837494 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837661 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837796 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.837963 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.838097 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.838261 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.838398 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.838563 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.838706 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.838881 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.839018 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.839185 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.839320 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.839488 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.839615 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.839792 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.839942 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.840140 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:46:33.840278 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.840473 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.840603 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.840804 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.840931 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.841127 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.841252 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.841441 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.841577 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.841755 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.841893 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.842081 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.842215 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.842394 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.842528 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.842704 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.842831 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843015 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843147 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843330 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843464 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843640 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843766 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.843978 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.844114 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.844292 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.844440 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.844606 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.844733 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.844922 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845058 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845232 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845360 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845549 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845677 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845864 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.845990 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.846182 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.846308 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.846492 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.846631 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.846816 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.846952 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.847145 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.847273 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.847453 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.847587 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.847767 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.847912 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.848109 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.848246 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.848419 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.848560 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.848729 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.848857 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849040 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849179 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849360 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849498 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849688 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849817 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.849999 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.850127 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.850309 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.850437 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.850618 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.850776 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.850982 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.851180 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.851395 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.851603 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.851737 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.851943 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.852255 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.852381 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.852566 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.852889 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.853060 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.853240 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.853369 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.853564 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.853701 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.853884 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854013 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854200 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854336 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854522 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854660 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854837 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.854966 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.855151 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.855287 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.855463 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.855603 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.855770 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.855931 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.856100 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.856228 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.856405 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.856535 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.856717 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.856845 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857021 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857151 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857323 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857442 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857643 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857778 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.857948 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.858087 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.858269 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.858397 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.858571 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.858751 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.858879 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859012 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859178 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859308 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859489 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859616 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859792 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.859996 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.860130 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.860263 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.860424 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.860556 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.860729 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.860868 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861059 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861188 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861372 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861501 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861679 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861817 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.861999 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.862134 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.862307 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.862445 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.862612 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.862742 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.862928 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.863066 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.863238 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.863365 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.863548 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.863683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.863898 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.864070 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.864199 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.864386 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.864525 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.864701 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.864829 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.865026 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.865154 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.865342 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.865485 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.865727 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.865866 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.866059 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.866186 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.866925 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.867054 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.867388 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.867567 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.867705 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.867930 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.868071 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.868244 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.868382 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.868560 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.868691 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.868867 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869017 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869177 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869294 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869483 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869606 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869795 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.869923 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.870100 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.870217 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.870405 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.870519 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.870709 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.870839 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871010 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871144 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871310 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871437 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871616 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871746 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.871966 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.872111 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.872272 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.872392 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.872574 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.872689 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.872883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.873014 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.873187 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.873325 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.873786 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.873917 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.874094 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.874223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.874462 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.874615 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.874768 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.874890 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.875089 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.875253 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.875414 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.875553 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.875727 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.875896 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.876073 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.876201 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.876386 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.876530 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.876697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.876827 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877008 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877145 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877329 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877466 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877639 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877768 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.877954 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.878082 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.878262 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.878397 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.878577 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.878704 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.878885 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879011 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879200 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879327 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879502 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879628 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879832 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.879974 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.880152 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.880283 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.880489 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.880616 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.880805 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.880934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.881125 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.881253 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.881432 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.881557 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.881745 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.881898 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.882651 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.882785 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.882947 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.883268 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.883417 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.883556 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.883683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.883895 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884029 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884218 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884356 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884517 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884645 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884835 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.884965 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.885144 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.885271 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.885466 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.885596 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.885776 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.885903 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.886091 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.886218 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.886396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.886525 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.886708 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.886848 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.887035 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.887174 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.887363 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.887502 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.887673 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.887799 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888008 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888147 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888330 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888459 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888640 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888766 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.888948 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889084 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889256 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889389 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889558 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889685 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889863 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.889998 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.890172 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.890298 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.890484 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.890610 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.890791 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.890926 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.891097 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.891223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.891396 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.891529 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.891712 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.891895 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892023 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892148 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892328 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892468 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892630 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892769 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.892938 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.893067 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.893256 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.893385 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.893564 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.893692 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.893881 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894021 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894198 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894320 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894501 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894628 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894800 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.894935 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.895118 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.895260 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.895425 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.895552 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.895725 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.895875 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.896053 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.896194 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.896355 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.896491 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.896696 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.896830 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.897003 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.897140 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.897306 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.897435 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.897647 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.897809 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.898059 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.898199 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.898372 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.898607 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.898740 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.898916 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.899055 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.899232 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.899369 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.899544 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.899673 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.899895 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900042 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900215 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900353 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900525 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900660 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900832 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.900968 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.901139 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.901267 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.901447 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.901590 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.901752 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.901889 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902059 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902187 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902368 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902497 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902676 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902813 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.902978 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.903097 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.903280 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.903406 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.903589 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.903719 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.903941 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.904190 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.904506 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.904636 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.904824 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.904959 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.905138 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.905272 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.905454 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.905582 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.905772 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.905903 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.906091 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.906227 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.906415 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.906556 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.906738 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.906864 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.907052 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.907188 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.907369 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.907572 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.907701 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.907858 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908000 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908127 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908285 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908413 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908587 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908714 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.908887 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909014 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909190 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909317 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909490 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909627 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909793 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.909920 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.910093 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.910220 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.910395 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.910531 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.910697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.910824 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911002 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911131 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911305 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911440 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911603 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911731 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.911929 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912058 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912231 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912368 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912548 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912676 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912851 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.912980 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.913171 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.913301 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.913479 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.913697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.913827 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.914045 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.914183 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.914394 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.914523 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.914703 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.914842 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.915039 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.915171 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.915366 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.915492 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.915674 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.915804 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916021 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916149 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916324 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916462 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916628 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916756 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.916931 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917070 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917232 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917359 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917535 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917664 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917835 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.917963 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.918140 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.918268 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.918442 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.918564 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.918749 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.918884 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919054 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919181 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919355 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919494 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919661 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919797 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.919988 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.920118 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.920299 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.920437 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.920602 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.920731 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.920904 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921030 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921207 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921345 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921508 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921634 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921814 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.921949 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.922119 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.922261 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.922424 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.922550 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.922726 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.922853 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923034 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923165 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923338 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923463 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923641 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923777 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.923969 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924095 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924260 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924390 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924562 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924698 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924870 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.924991 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.925180 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.925309 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.925481 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.925609 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.925796 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.925922 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.926101 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.926228 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.926399 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.926526 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.926701 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.926830 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927003 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927129 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927305 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927440 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927605 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927733 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.927938 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.928071 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.928240 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.928379 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.928552 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.928674 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.929368 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.929501 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.929677 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.929943 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.930079 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.930262 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.930391 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.930565 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.930699 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.930869 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931003 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931171 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931298 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931472 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931613 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931771 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.931930 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.932103 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.932231 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.932406 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.932543 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.932707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.932844 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933012 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933139 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933318 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933455 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933617 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933744 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.933923 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.934051 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.934230 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.934359 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.934574 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.934717 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.934877 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935005 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935200 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935362 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935511 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935640 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935842 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.935974 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.936308 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.936434 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.936558 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.936754 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.936884 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937063 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937200 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937364 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937491 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937677 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937803 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.937982 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.938117 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.938294 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.938430 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.938598 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.938735 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.938900 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939036 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939218 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939348 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939522 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939658 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939841 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.939974 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.940167 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.940307 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.940477 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.940613 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.940789 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.940918 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.941089 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.941217 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.941396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.941532 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.941702 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.941828 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942008 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942137 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942316 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942444 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942621 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942748 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.942929 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.943063 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.943234 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.943369 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.943537 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.943664 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.943867 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.944000 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.944178 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.944307 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.945034 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.945170 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.945366 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.945679 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.945816 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.945984 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.946112 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.946296 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.946424 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.946602 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.946732 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.946912 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947041 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947216 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947346 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947528 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947656 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947855 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.947988 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.948172 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.948301 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.948479 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.948617 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.948851 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.948978 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.949163 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.949291 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.949480 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.949616 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.949792 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.949919 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.950093 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.950228 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.950401 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.950528 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.950717 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.950846 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.951032 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.951171 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.951335 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.951472 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.951688 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.951842 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952019 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952160 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952329 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952458 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952652 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952781 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.952958 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.953100 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.953261 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.953396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.953562 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.953697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.953883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954018 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954185 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954311 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954487 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954617 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954792 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.954921 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.955114 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.955242 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.955419 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.955555 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.955736 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.955912 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.956178 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.956307 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.956490 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.956620 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.956794 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.956924 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.957123 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.957250 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.957452 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.957594 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.957757 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.957886 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.958069 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.958197 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.958378 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.958599 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.958737 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.958903 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959031 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959156 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959281 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959407 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959590 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959727 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.959920 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.960123 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.960296 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.960435 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.960562 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.960878 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961007 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961199 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961328 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961505 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961633 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961834 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.961966 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.962163 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.962292 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.962480 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.962623 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.962804 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.962946 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.963131 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.963251 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.963435 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.963572 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.963746 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.963929 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.964060 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.964185 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.964372 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.964512 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.964693 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.964823 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965001 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965131 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965312 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965448 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965624 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965751 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.965929 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966058 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966234 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966369 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966538 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966674 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966850 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.966980 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.967161 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.967292 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.967470 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.967599 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.967774 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.967921 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.968101 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.968233 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.968422 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.968555 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.968726 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.968855 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969047 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969177 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969361 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969490 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969680 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969817 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.969998 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.970124 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.970299 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.970427 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.970617 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.970760 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.970924 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971053 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971355 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971529 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971666 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971849 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.971982 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.972201 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.972330 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.972506 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.972645 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.972824 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.972953 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.973149 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.973278 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.973466 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.973601 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.973773 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.973900 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.974087 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.974221 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.974392 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.974522 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.974705 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.974843 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975012 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975140 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975321 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975458 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975640 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975782 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.975978 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.976177 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.976489 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.976620 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.976748 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.976873 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977006 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977143 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977277 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977403 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977536 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977663 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977798 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.977968 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.978099 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.978273 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.978410 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.978574 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.978703 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.978893 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979023 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979195 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979324 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979514 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979642 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979837 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.979982 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.980144 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.980282 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.980448 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.980586 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.980749 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.980880 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.981088 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.981219 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.981390 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.981528 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.981721 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.981850 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982041 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982497 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982676 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982813 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.982981 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.983116 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.983294 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.983423 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.983606 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.983734 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.983938 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.984066 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.984254 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.984387 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.984567 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.984695 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.984877 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.985011 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.985192 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.985399 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.985528 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.985734 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.985862 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.986055 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.986193 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.986375 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.986502 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.986691 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.986820 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.987007 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.987202 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.987331 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.987528 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.987661 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.987861 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988009 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988177 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988307 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988487 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988616 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988800 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.988942 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.989110 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.989240 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.989419 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.989555 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.989728 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.989866 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990037 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990165 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990344 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990473 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990670 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990799 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.990990 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.991119 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.991853 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.992090 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.992390 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.992521 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.992703 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.992839 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993022 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993160 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993341 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993479 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993659 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993788 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.993973 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.994110 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.994285 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.994414 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.994601 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.994730 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.994916 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.995046 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.995230 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.995365 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.995541 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.995670 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.995876 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996009 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996193 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996324 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996518 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996655 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996828 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.996963 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.997137 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.997267 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.997446 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.997575 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.997760 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.997897 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.998072 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.998208 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.998676 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.998855 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.998983 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.999176 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.999302 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.999512 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.999646 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.999855 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:33.999985 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.000186 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.000313 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.000508 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.000726 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.000867 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.001041 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.001169 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.001372 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.001500 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.001692 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.001826 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002013 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002143 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002330 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002459 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002651 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002774 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.002978 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.003264 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.003400 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.003568 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.003705 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.003887 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.004017 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.004196 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.004326 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.004498 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.004640 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.004817 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.005032 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.005173 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.005381 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.005523 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.005699 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.005820 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.006006 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.006141 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.006338 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.006546 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.006675 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.006888 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.007125 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.007314 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.007444 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.007624 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.007914 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.008048 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.008248 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.008378 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.008569 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.008713 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.008872 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009000 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009179 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009316 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009490 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009618 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009796 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.009925 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.010099 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.010228 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.010409 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.010537 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.010712 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.010839 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011013 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011141 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011324 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011454 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011627 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011755 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.011938 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012063 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012250 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012381 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012553 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012681 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012859 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.012997 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.013164 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.013292 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.013464 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.013591 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.013766 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.013904 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014066 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014201 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014369 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014544 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014671 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014805 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.014962 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.015089 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.015258 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.015382 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.015566 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.015704 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.015885 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016025 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016196 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016325 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016498 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016628 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016804 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.016933 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.017106 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.017242 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.017413 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.017544 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.017762 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.017896 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018075 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018204 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018376 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018504 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018678 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018807 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.018992 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.019121 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.019298 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.019545 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.019683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.019906 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.020050 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.020230 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.020367 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.020565 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.020696 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.020879 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.021006 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.021197 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.021406 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.021536 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.021740 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.021870 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.022061 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.022199 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.022394 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.023040 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.023223 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.023383 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.023589 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.023806 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024001 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024129 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024317 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024445 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024631 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024761 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.024943 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.025071 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.025256 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.025393 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.025568 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.025698 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.025881 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026006 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026192 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026321 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026502 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026640 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026817 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.026947 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.027124 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.027264 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.027433 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.027564 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.027743 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.027901 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.028076 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.028219 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.028387 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.028517 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.028703 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.028832 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029010 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029140 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029322 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029459 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029632 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029761 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.029946 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.030075 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.030260 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.030397 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.030569 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.030698 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.030874 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031002 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031178 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031306 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031484 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031614 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031796 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.031958 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.032143 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.032276 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.032454 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.032593 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.032758 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.032895 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.033151 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.033280 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.033462 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.033604 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.033779 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.033906 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.034088 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.034216 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.034392 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.034533 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.034711 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.034841 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035033 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035171 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035341 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035479 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035659 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035788 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.035985 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.036107 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.036313 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.036443 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.036569 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.036695 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.036890 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037027 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037199 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037329 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037502 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037631 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037804 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.037933 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.038140 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.038303 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.038544 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.038699 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.038919 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.039222 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.039398 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.039527 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.039708 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.039859 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040049 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040191 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040356 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040485 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040662 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040791 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.040968 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.041107 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.041274 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.041404 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.041580 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.041711 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.041884 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042027 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042183 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042311 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042485 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042615 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042786 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.042921 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.043089 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.043266 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.043403 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.043528 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.043662 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.043798 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044004 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044134 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044307 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044448 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044610 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044740 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.044912 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045041 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045213 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045356 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045514 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045644 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045844 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.045975 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.046163 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.046302 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.046476 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.046603 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.046789 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.046916 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.047095 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.047232 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.047415 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.047551 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.047722 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.047909 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048046 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048184 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048365 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048494 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048674 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048802 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.048983 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.049113 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.049290 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.049417 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.049608 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.049735 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.049918 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050049 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050226 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050352 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050533 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050667 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050841 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.050971 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.051149 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.051277 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.051470 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.051596 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.051780 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.051944 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.052107 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.052235 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.052430 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.052568 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.052745 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.052875 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.053057 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.053186 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.053367 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.053505 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.053673 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.054320 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.054672 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.054801 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.055011 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.055203 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.055335 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.055525 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.055779 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.055957 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.056127 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.056257 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.056457 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.056594 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.056780 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.056916 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.057102 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.057233 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.057427 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.057554 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.057754 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.057881 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.058068 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.058197 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.058393 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.058521 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.058704 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.058850 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.059020 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.059146 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.059272 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 13:46:34.059405 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.059682 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.060034 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.060350 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.060661 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.060966 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:46:34.061207 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103070) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 13:46:34.118769 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO dbcounter [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Registered counter for database nova_api May 24 13:46:34.121203 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO dbcounter [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Registered counter for database nova_api May 24 13:46:34.140415 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.142052 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_db.sqlalchemy.engines [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.147122 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writer thread running {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.149183 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writer thread running {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.206477 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.context [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d750e084-f072-4f5c-be8b-4cec57d0cd04(cell1) {{(pid=103069) load_cells /opt/stack/nova/nova/context.py:464}} May 24 13:46:34.207510 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.context [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d750e084-f072-4f5c-be8b-4cec57d0cd04(cell1) {{(pid=103070) load_cells /opt/stack/nova/nova/context.py:464}} May 24 13:46:34.211258 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_concurrency.lockutils [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:46:34.212456 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:46:34.212885 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_concurrency.lockutils [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:46:34.213684 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_concurrency.lockutils [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:46:34.214025 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:46:34.214814 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:46:34.215685 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_concurrency.lockutils [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:46:34.216804 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:46:34.217690 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO dbcounter [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Registered counter for database nova_cell0 May 24 13:46:34.218762 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO dbcounter [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Registered counter for database nova_cell0 May 24 13:46:34.221835 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO dbcounter [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Registered counter for database nova_cell1 May 24 13:46:34.222628 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO dbcounter [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Registered counter for database nova_cell1 May 24 13:46:34.229258 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.230879 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_db.sqlalchemy.engines [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.234517 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writer thread running {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.234751 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_db.sqlalchemy.engines [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.236069 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.236318 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writer thread running {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.379271 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writer thread running {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.379458 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writer thread running {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.389082 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO dbcounter [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Registered counter for database nova_cell0 May 24 13:46:34.389245 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO dbcounter [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Registered counter for database nova_cell0 May 24 13:46:34.398435 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_db.sqlalchemy.engines [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103070) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.401831 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG oslo_db.sqlalchemy.engines [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:46:34.402879 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writer thread running {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.406178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writer thread running {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:46:34.740059 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: WARNING keystonemiddleware.auth_token [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:46:34.744644 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: WARNING keystonemiddleware.auth_token [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:46:34.748086 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: WARNING keystonemiddleware.auth_token [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:46:34.752012 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: WARNING keystonemiddleware.auth_token [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:46:35.105085 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: WARNING keystonemiddleware.auth_token [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:46:35.109419 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: WARNING keystonemiddleware.auth_token [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:46:35.110942 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: WARNING keystonemiddleware.auth_token [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:46:35.115260 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: WARNING keystonemiddleware.auth_token [None req-bbf3545c-fc2b-4c5d-af2e-7d026497459c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:46:35.116350 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639de4929c0 pid: 103070 (default app) May 24 13:46:35.118646 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:46:35.119849 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 May 24 13:46:35.120260 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Tue May 24 13:46:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:46:35.120909 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5639de4929c0 pid: 103069 (default app) May 24 13:47:53.686260 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:53.687301 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 24 13:47:53.687690 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:47:53.700096 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writing DB stats nova_api:SELECT=3 {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.700910 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writing DB stats nova_cell0:SELECT=3 {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.702405 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writing DB stats nova_cell1:SELECT=3 {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:53.703673 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:54.184114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-e5662645-aa3c-4d3b-b0bb-3a8f45bde816 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:54.215882 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-e5662645-aa3c-4d3b-b0bb-3a8f45bde816 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.520770 May 24 13:47:54.217169 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 24 13:47:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:47:56.517238 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:56.518268 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-667674f0-5f88-4582-8094-9ff8302acb91 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 24 13:47:56.518850 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:47:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:47:56.581246 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-a8ec61e3-709b-4daa-9758-abb0feb21191 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "ram": 256, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:47:56.599750 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:47:56.599750 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: warnings.warn(msg) May 24 13:47:56.633383 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-a8ec61e3-709b-4daa-9758-abb0feb21191 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108312 May 24 13:47:56.634162 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:47:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 13:47:56.648109 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_api:SELECT=3 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:56.649397 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_cell0:SELECT=3 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:56.650741 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_cell1:SELECT=3 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:56.651580 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:47:56.862084 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-068abb1f-1107-4ed1-b213-ace9cdd34cf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:47:56.864748 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:47:56.864748 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: warnings.warn(msg) May 24 13:47:56.929525 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-068abb1f-1107-4ed1-b213-ace9cdd34cf5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287426 May 24 13:47:56.935033 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 24 13:47:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:47:59.206046 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-a8ec61e3-709b-4daa-9758-abb0feb21191 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:47:59.207199 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-a8ec61e3-709b-4daa-9758-abb0feb21191 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 24 13:47:59.208649 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:47:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:47:59.321409 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-9be497cb-d12c-4627-b212-8b7ab5b77ebd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:47:59.339082 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:47:59.339082 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: warnings.warn(msg) May 24 13:47:59.356759 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-9be497cb-d12c-4627-b212-8b7ab5b77ebd admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141835 May 24 13:47:59.357326 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:47:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:47:59.370189 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-68738feb-d8a9-42b9-9112-519e66a584c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:47:59.372004 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:47:59.372004 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: warnings.warn(msg) May 24 13:47:59.404339 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-68738feb-d8a9-42b9-9112-519e66a584c6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037713 May 24 13:47:59.405163 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 24 13:47:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:48:01.675178 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-9be497cb-d12c-4627-b212-8b7ab5b77ebd admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:01.676310 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-9be497cb-d12c-4627-b212-8b7ab5b77ebd admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 24 13:48:01.677202 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:01.740272 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-c87046a8-bc0c-4396-b8e0-c87b7edf57b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "ram": 1024}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:01.760198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-c87046a8-bc0c-4396-b8e0-c87b7edf57b0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076747 May 24 13:48:01.760716 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 13:48:01.773342 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-81d7b20f-4c5f-4ba7-8d4b-2375675c075a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:01.796351 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-81d7b20f-4c5f-4ba7-8d4b-2375675c075a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027284 May 24 13:48:01.796932 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 24 13:48:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:04.081952 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-c87046a8-bc0c-4396-b8e0-c87b7edf57b0 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:04.083536 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-c87046a8-bc0c-4396-b8e0-c87b7edf57b0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 May 24 13:48:04.083986 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:04.147654 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-b85e8e91-7dc3-4d4c-a63a-9f458c435213 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "id": "d3"}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:04.166415 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-b85e8e91-7dc3-4d4c-a63a-9f458c435213 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075988 May 24 13:48:04.166976 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:04.179052 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-59ec1f5d-2236-4188-9ed8-f96934ac1d57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:04.202806 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-59ec1f5d-2236-4188-9ed8-f96934ac1d57 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027565 May 24 13:48:04.203384 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 24 13:48:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:06.507853 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-b85e8e91-7dc3-4d4c-a63a-9f458c435213 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:06.508493 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-b85e8e91-7dc3-4d4c-a63a-9f458c435213 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 May 24 13:48:06.509204 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:06.568533 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-5c709946-97a2-42a2-b7ef-74e8fd41a6ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "name": "ds4G", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:06.585814 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-5c709946-97a2-42a2-b7ef-74e8fd41a6ef admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070929 May 24 13:48:06.586562 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 13:48:06.598709 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-7adfa2f1-79e8-43c7-846e-ccf27f36c896 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:06.620972 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-7adfa2f1-79e8-43c7-846e-ccf27f36c896 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026599 May 24 13:48:06.621529 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 24 13:48:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:08.889113 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-5c709946-97a2-42a2-b7ef-74e8fd41a6ef admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:08.890163 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-5c709946-97a2-42a2-b7ef-74e8fd41a6ef admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 24 13:48:08.890589 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:08.954387 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-b2d0bd8d-c1f1-4dfd-938e-05a16c1b2859 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:08.978670 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-b2d0bd8d-c1f1-4dfd-938e-05a16c1b2859 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080666 May 24 13:48:08.979411 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 24 13:48:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:11.464283 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-5c709946-97a2-42a2-b7ef-74e8fd41a6ef admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:11.465300 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-5c709946-97a2-42a2-b7ef-74e8fd41a6ef admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 24 13:48:11.465704 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:11.531030 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-adf1a52a-9c10-4b68-b156-6c6806080932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "name": "m1.tiny", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:11.551290 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-adf1a52a-9c10-4b68-b156-6c6806080932 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079833 May 24 13:48:11.551860 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 13:48:11.565017 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-6c2cadda-9029-4bb8-a1d3-8decb340c3e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:11.593137 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-6c2cadda-9029-4bb8-a1d3-8decb340c3e1 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032802 May 24 13:48:11.593999 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 24 13:48:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:14.265736 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-adf1a52a-9c10-4b68-b156-6c6806080932 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:14.266952 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-adf1a52a-9c10-4b68-b156-6c6806080932 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001771 May 24 13:48:14.267463 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:14.337084 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-972e4992-8f74-4f53-b4f5-da8a54a8b7d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:14.355238 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-972e4992-8f74-4f53-b4f5-da8a54a8b7d6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081604 May 24 13:48:14.355831 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:14.367952 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-3c236f9b-7d58-41d1-a815-6afb5d5b217c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:14.390834 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-3c236f9b-7d58-41d1-a815-6afb5d5b217c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026894 May 24 13:48:14.391410 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 24 13:48:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:16.977075 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-972e4992-8f74-4f53-b4f5-da8a54a8b7d6 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:16.978239 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-972e4992-8f74-4f53-b4f5-da8a54a8b7d6 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 May 24 13:48:16.978738 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:17.039944 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-d3e9da89-92b4-4256-aa3e-bcbe4062a0ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:17.057146 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-d3e9da89-92b4-4256-aa3e-bcbe4062a0ee admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072403 May 24 13:48:17.057697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:17.070034 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-a12ead3b-2cea-447d-a134-82c22a1baa59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:17.092801 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-a12ead3b-2cea-447d-a134-82c22a1baa59 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026895 May 24 13:48:17.093375 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 24 13:48:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:19.364819 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-d3e9da89-92b4-4256-aa3e-bcbe4062a0ee admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:19.366594 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-d3e9da89-92b4-4256-aa3e-bcbe4062a0ee admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002920 May 24 13:48:19.366998 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:19.431884 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-01951945-72cb-4944-a63e-d1da65518d9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:19.455917 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-01951945-72cb-4944-a63e-d1da65518d9e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082388 May 24 13:48:19.456749 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:19.468603 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-ca017266-bf9a-4883-a346-71ffff0ab794 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:19.495161 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-ca017266-bf9a-4883-a346-71ffff0ab794 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030068 May 24 13:48:19.495728 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 24 13:48:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:48:21.789922 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-01951945-72cb-4944-a63e-d1da65518d9e admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:21.791534 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-01951945-72cb-4944-a63e-d1da65518d9e admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 May 24 13:48:21.792410 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:21.856894 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-30deba9a-c687-427f-828f-5a84beebfcd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "name": "m1.xlarge", "swap": 0}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:21.878443 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-30deba9a-c687-427f-828f-5a84beebfcd0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080225 May 24 13:48:21.879409 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 24 13:48:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:21.899526 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-a2770597-f0c8-4b71-b2e1-0ee6839a460a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:21.935767 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-a2770597-f0c8-4b71-b2e1-0ee6839a460a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047357 May 24 13:48:21.937312 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 24 13:48:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:48:45.872356 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-30deba9a-c687-427f-828f-5a84beebfcd0 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:45.873371 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-30deba9a-c687-427f-828f-5a84beebfcd0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 24 13:48:45.873768 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:45.885218 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:48:45.933834 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-9c936942-4b4c-4e80-afb1-08984346a5e5 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:45.951193 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-9c936942-4b4c-4e80-afb1-08984346a5e5 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071159 May 24 13:48:45.951723 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 24 13:48:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:46.938391 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-30deba9a-c687-427f-828f-5a84beebfcd0 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:46.939435 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-30deba9a-c687-427f-828f-5a84beebfcd0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 24 13:48:46.939857 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:47.129213 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-d6919a60-e143-485a-a8a8-e90f150f2263 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:47.135330 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.wsgi [None req-d6919a60-e143-485a-a8a8-e90f150f2263 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-d6919a60-e143-485a-a8a8-e90f150f2263 admin admin] Request method failure captured: May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Accept: application/json May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Accept-Encoding: gzip, deflate May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Connection: keep-alive May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Content-Length: 0 May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Host: 10.222.0.24 May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Openstack-Api-Version: compute 2.90 May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Openstack-System-Scope: None May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: User-Agent: python-novaclient May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Auth-Token: gAAAAABijOI-ahHMP3NN_ZI0PhkWTEnfS8coZ5zWVNbmvaazpjj98vOo5gKTtnq4jkqLUei-XHzmj1K_d4HYEfgQlaRuR6P9hO7HJ4pnEBKzzpIEZCL6BchLj2rHiXey75ENm1Tvz_lyy3ARGeDnO2UytJGU0RE6-tbDybafNPf9dCjJU1_YgRM May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Domain-Id: None May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Domain-Name: None May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Identity-Status: Confirmed May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Is-Admin-Project: True May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Openstack-Nova-Api-Version: 2.90 May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Domain-Id: default May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Domain-Name: Default May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Name: admin May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Role: reader,admin,member May 24 13:48:47.138576 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Roles: reader,admin,member May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant: admin May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant-Name: admin May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User: admin May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Domain-Id: default May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Domain-Name: Default May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Id: a064d7a4fdb343efa665d8a825cdfba7 May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Name: admin May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: method: > May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: exception: Flavor 42 could not be found. May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: action_args: {'id': '42'} May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:48:47.140371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:47.141361 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:47.142883 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-d6919a60-e143-485a-a8a8-e90f150f2263 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:48:47.144212 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-d6919a60-e143-485a-a8a8-e90f150f2263 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061501 May 24 13:48:47.144212 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 24 13:48:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 13:48:47.150399 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-9390e8b3-35bd-4256-a116-2ec2e9d9e659 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:47.153303 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:48:47.172405 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-9390e8b3-35bd-4256-a116-2ec2e9d9e659 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026278 May 24 13:48:47.172945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 24 13:48:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:47.182608 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-168587fd-7cfb-40d6-93a9-68aba6ed276f admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:47.204109 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-168587fd-7cfb-40d6-93a9-68aba6ed276f admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025026 May 24 13:48:47.204636 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 24 13:48:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:47.214240 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-4f232f19-65b0-42b5-b5b2-481d0bf9b546 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:47.220475 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.wsgi [None req-4f232f19-65b0-42b5-b5b2-481d0bf9b546 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-4f232f19-65b0-42b5-b5b2-481d0bf9b546 admin admin] Request method failure captured: May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Accept: application/json May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Accept-Encoding: gzip, deflate May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Connection: keep-alive May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Content-Length: 0 May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Host: 10.222.0.24 May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Openstack-Api-Version: compute 2.90 May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Openstack-System-Scope: None May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: User-Agent: python-novaclient May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Auth-Token: gAAAAABijOI-ahHMP3NN_ZI0PhkWTEnfS8coZ5zWVNbmvaazpjj98vOo5gKTtnq4jkqLUei-XHzmj1K_d4HYEfgQlaRuR6P9hO7HJ4pnEBKzzpIEZCL6BchLj2rHiXey75ENm1Tvz_lyy3ARGeDnO2UytJGU0RE6-tbDybafNPf9dCjJU1_YgRM May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Domain-Id: None May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Domain-Name: None May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Identity-Status: Confirmed May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Is-Admin-Project: True May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Openstack-Nova-Api-Version: 2.90 May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Domain-Id: default May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Domain-Name: Default May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Name: admin May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Role: reader,admin,member May 24 13:48:47.223683 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Roles: reader,admin,member May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant: admin May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant-Name: admin May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User: admin May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Domain-Id: default May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Domain-Name: Default May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Id: a064d7a4fdb343efa665d8a825cdfba7 May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Name: admin May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: method: > May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: exception: Flavor 42 could not be found. May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: action_args: {'id': '42'} May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:48:47.225277 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:47.226223 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:47.227550 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-4f232f19-65b0-42b5-b5b2-481d0bf9b546 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:48:47.228782 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-4f232f19-65b0-42b5-b5b2-481d0bf9b546 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015038 May 24 13:48:47.228782 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 24 13:48:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 24 13:48:48.088153 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-168587fd-7cfb-40d6-93a9-68aba6ed276f admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:48.089160 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-168587fd-7cfb-40d6-93a9-68aba6ed276f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 24 13:48:48.089553 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:48.277872 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-8fea7faa-3a53-4741-92c2-b950a9e10bef admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:48.283700 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.wsgi [None req-8fea7faa-3a53-4741-92c2-b950a9e10bef admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-8fea7faa-3a53-4741-92c2-b950a9e10bef admin admin] Request method failure captured: May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Accept: application/json May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Accept-Encoding: gzip, deflate May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Connection: keep-alive May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Content-Length: 0 May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Host: 10.222.0.24 May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Openstack-Api-Version: compute 2.90 May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Openstack-System-Scope: None May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: User-Agent: python-novaclient May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Auth-Token: gAAAAABijOJAr2T3KcMhW7Hv59dhvaYou0eAXa0ZfX9E1ccwS3Kf3Ydoa1eQtgtIDiV_K0CotwePCl3fTqBfiJRp_K1lxzZEerPvCnU1H9XB4c1lRdpIk26A91_oiVRa1jpfI9GOEVnrNNNtV8-41z4HRTOvNkPXHn1WzFV7VRHAZ64hHDvJ8x8 May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Domain-Id: None May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Domain-Name: None May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Identity-Status: Confirmed May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Is-Admin-Project: True May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Openstack-Nova-Api-Version: 2.90 May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Domain-Id: default May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Domain-Name: Default May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Name: admin May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Role: reader,admin,member May 24 13:48:48.285226 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Roles: reader,admin,member May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant: admin May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant-Name: admin May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User: admin May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Domain-Id: default May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Domain-Name: Default May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Id: a064d7a4fdb343efa665d8a825cdfba7 May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Name: admin May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: method: > May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: exception: Flavor 84 could not be found. May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: action_args: {'id': '84'} May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:48:48.286697 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:48.287707 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:48.289718 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-8fea7faa-3a53-4741-92c2-b950a9e10bef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:48:48.290947 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-8fea7faa-3a53-4741-92c2-b950a9e10bef admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061166 May 24 13:48:48.290947 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 24 13:48:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 13:48:48.296849 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-51f4a2a7-f5d3-45cc-95a0-3202ba5e0025 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:48.311944 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-51f4a2a7-f5d3-45cc-95a0-3202ba5e0025 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018602 May 24 13:48:48.312397 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 24 13:48:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:48.321676 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-7d3158c9-e3fc-4182-bc24-3e091f00ac4b admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:48.335134 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-7d3158c9-e3fc-4182-bc24-3e091f00ac4b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017126 May 24 13:48:48.336309 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 24 13:48:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:48.345231 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-275b092b-1cd3-4204-bc76-318790949a9a admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:48.350471 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.wsgi [None req-275b092b-1cd3-4204-bc76-318790949a9a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-275b092b-1cd3-4204-bc76-318790949a9a admin admin] Request method failure captured: May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Accept: application/json May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Accept-Encoding: gzip, deflate May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Connection: keep-alive May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Content-Length: 0 May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Host: 10.222.0.24 May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Openstack-Api-Version: compute 2.90 May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Openstack-System-Scope: None May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: User-Agent: python-novaclient May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Auth-Token: gAAAAABijOJAr2T3KcMhW7Hv59dhvaYou0eAXa0ZfX9E1ccwS3Kf3Ydoa1eQtgtIDiV_K0CotwePCl3fTqBfiJRp_K1lxzZEerPvCnU1H9XB4c1lRdpIk26A91_oiVRa1jpfI9GOEVnrNNNtV8-41z4HRTOvNkPXHn1WzFV7VRHAZ64hHDvJ8x8 May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Domain-Id: None May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Domain-Name: None May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Identity-Status: Confirmed May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Is-Admin-Project: True May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Openstack-Nova-Api-Version: 2.90 May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Domain-Id: default May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Domain-Name: Default May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Name: admin May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Role: reader,admin,member May 24 13:48:48.352607 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Roles: reader,admin,member May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant: admin May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant-Name: admin May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User: admin May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Domain-Id: default May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Domain-Name: Default May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Id: a064d7a4fdb343efa665d8a825cdfba7 May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Name: admin May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: method: > May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: exception: Flavor 84 could not be found. May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: action_args: {'id': '84'} May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:48:48.354114 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:48.354934 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:48.356198 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-275b092b-1cd3-4204-bc76-318790949a9a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:48:48.357408 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-275b092b-1cd3-4204-bc76-318790949a9a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012245 May 24 13:48:48.357408 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 24 13:48:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 13:48:49.216322 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-7d3158c9-e3fc-4182-bc24-3e091f00ac4b admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:49.217392 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-7d3158c9-e3fc-4182-bc24-3e091f00ac4b admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 24 13:48:49.217810 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:49.407101 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-c5855a7d-f219-4f07-bc4c-801a4111b25a admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:49.412819 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.wsgi [None req-c5855a7d-f219-4f07-bc4c-801a4111b25a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-c5855a7d-f219-4f07-bc4c-801a4111b25a admin admin] Request method failure captured: May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Accept: application/json May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Accept-Encoding: gzip, deflate May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Connection: keep-alive May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Content-Length: 0 May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Host: 10.222.0.24 May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Openstack-Api-Version: compute 2.90 May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Openstack-System-Scope: None May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: User-Agent: python-novaclient May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Auth-Token: gAAAAABijOJB3Xw7_XKlKkYe1aElFdu2hQ3jMaMAFhaS9Fd9AvQ90rP9ZiIRkNuE3VIAos0wt55rOk_LUqPckuqL7pWGoVtHlIBtctrICK03tGQQ8rkeX8lc9uCktFS0RgH4aAA-WEzb5Ba-E0uOvlwt4PAbWNP7HKIlrWDdlUdZfWt1mKaw64w May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Domain-Id: None May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Domain-Name: None May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Identity-Status: Confirmed May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Is-Admin-Project: True May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Openstack-Nova-Api-Version: 2.90 May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Domain-Id: default May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Domain-Name: Default May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Project-Name: admin May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Role: reader,admin,member May 24 13:48:49.414907 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Roles: reader,admin,member May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant: admin May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-Tenant-Name: admin May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User: admin May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Domain-Id: default May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Domain-Name: Default May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Id: a064d7a4fdb343efa665d8a825cdfba7 May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: X-User-Name: admin May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: method: > May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: exception: Flavor 451 could not be found. May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: action_args: {'id': '451'} May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:48:49.416396 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:49.417178 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: ERROR nova.api.openstack.wsgi May 24 13:48:49.418241 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-c5855a7d-f219-4f07-bc4c-801a4111b25a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:48:49.419226 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-c5855a7d-f219-4f07-bc4c-801a4111b25a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061169 May 24 13:48:49.419226 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 24 13:48:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 13:48:49.425977 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-9cca0f62-fea2-41a0-9926-3b907f46c6a9 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:49.446725 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-9cca0f62-fea2-41a0-9926-3b907f46c6a9 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024127 May 24 13:48:49.447283 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 24 13:48:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:48:49.461135 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:49.483130 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028008 May 24 13:48:49.483973 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 24 13:48:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 13:48:49.494506 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-71535be7-f2cc-49c5-93dd-fa19d5807b94 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:49.500021 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.wsgi [None req-71535be7-f2cc-49c5-93dd-fa19d5807b94 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-71535be7-f2cc-49c5-93dd-fa19d5807b94 admin admin] Request method failure captured: May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Accept: application/json May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Accept-Encoding: gzip, deflate May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Connection: keep-alive May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Content-Length: 0 May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Host: 10.222.0.24 May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Openstack-Api-Version: compute 2.90 May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Openstack-System-Scope: None May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: User-Agent: python-novaclient May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Auth-Token: gAAAAABijOJB3Xw7_XKlKkYe1aElFdu2hQ3jMaMAFhaS9Fd9AvQ90rP9ZiIRkNuE3VIAos0wt55rOk_LUqPckuqL7pWGoVtHlIBtctrICK03tGQQ8rkeX8lc9uCktFS0RgH4aAA-WEzb5Ba-E0uOvlwt4PAbWNP7HKIlrWDdlUdZfWt1mKaw64w May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Domain-Id: None May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Domain-Name: None May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Identity-Status: Confirmed May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Is-Admin-Project: True May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Openstack-Nova-Api-Version: 2.90 May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Domain-Id: default May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Domain-Name: Default May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Project-Name: admin May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Role: reader,admin,member May 24 13:48:49.501513 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Roles: reader,admin,member May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4d5cb275b4fb4682b096f6cd5768d3fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant: admin May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant-Id: 4d5cb275b4fb4682b096f6cd5768d3fe May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-Tenant-Name: admin May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User: admin May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Domain-Id: default May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Domain-Name: Default May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Id: a064d7a4fdb343efa665d8a825cdfba7 May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: X-User-Name: admin May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: method: > May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: exception: Flavor 451 could not be found. May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: action_args: {'id': '451'} May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:48:49.503067 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:49.503945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: ERROR nova.api.openstack.wsgi May 24 13:48:49.505157 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-71535be7-f2cc-49c5-93dd-fa19d5807b94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:48:49.506580 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-71535be7-f2cc-49c5-93dd-fa19d5807b94 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013234 May 24 13:48:49.506580 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 24 13:48:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 13:48:50.368792 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:50.369826 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 24 13:48:50.370214 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:50.558646 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-f5ec39ff-39e5-4839-91b1-87f3fd439a56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:50.576001 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-f5ec39ff-39e5-4839-91b1-87f3fd439a56 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068557 May 24 13:48:50.576532 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 24 13:48:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:51.449852 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:51.450859 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 24 13:48:51.451254 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:51.641311 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-882e9da7-866a-40f9-9d02-dd6e924900a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:51.658756 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-882e9da7-866a-40f9-9d02-dd6e924900a9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068267 May 24 13:48:51.659332 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 24 13:48:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:52.546676 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:52.547671 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 24 13:48:52.548096 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:52.734941 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-ace2b572-77db-43e6-81fe-dd76b5159947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:52.752509 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-ace2b572-77db-43e6-81fe-dd76b5159947 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067461 May 24 13:48:52.753080 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 24 13:48:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:48:53.620371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:53.621379 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 24 13:48:53.621780 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:53.819966 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-2498a75c-fe47-4e21-87a8-d899f3c2376b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:48:53.837335 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-2498a75c-fe47-4e21-87a8-d899f3c2376b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070615 May 24 13:48:53.837882 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 24 13:48:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 13:48:54.707839 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:54.708844 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 24 13:48:54.709246 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:48:54.895629 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-2a0106c5-ec91-4830-81b9-e3c88ddc3511 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:48:54.914827 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-2a0106c5-ec91-4830-81b9-e3c88ddc3511 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070519 May 24 13:48:54.915358 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Tue May 24 13:48:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:49:57.103569 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:57.104606 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-342cdbe6-0fbe-4beb-a3b7-a2eab0b062b1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 24 13:49:57.105003 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 24 13:49:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:49:57.112315 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:49:57.164479 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-8e29d81b-8b9d-4010-b424-08415839061c admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:57.183675 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-8e29d81b-8b9d-4010-b424-08415839061c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072859 May 24 13:49:57.184236 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 24 13:49:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:49:57.205128 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG dbcounter [-] [103069] Writing DB stats nova_api:SELECT=14 {{(pid=103069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:49:57.208822 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-0c80a07e-ea56-4153-9a04-c50fd9c46a29 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:57.216904 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-0c80a07e-ea56-4153-9a04-c50fd9c46a29 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013245 May 24 13:49:57.217422 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Tue May 24 13:49:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:49:57.228918 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-2b088122-7cc5-4a65-9e50-7b1c6fd6506f admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:57.236462 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-2b088122-7cc5-4a65-9e50-7b1c6fd6506f admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011294 May 24 13:49:57.236965 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Tue May 24 13:49:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:49:57.248384 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:57.256055 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011135 May 24 13:49:57.256560 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Tue May 24 13:49:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:49:57.269336 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-26e7d6d5-9840-41be-98a8-dbe237444074 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:49:57.277398 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-26e7d6d5-9840-41be-98a8-dbe237444074 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011475 May 24 13:49:57.277911 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Tue May 24 13:49:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:53:29.678748 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:29.679759 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 24 13:53:29.680182 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:53:29.837079 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_api:SELECT=6 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:53:29.956098 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-bea46a5b-2d9d-4533-95d5-2b16e323d869 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:29.957268 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:53:29.957268 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: warnings.warn(msg) May 24 13:53:29.958498 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-bea46a5b-2d9d-4533-95d5-2b16e323d869 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:29.959038 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-bea46a5b-2d9d-4533-95d5-2b16e323d869 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:29.960028 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-bea46a5b-2d9d-4533-95d5-2b16e323d869 admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:29.960461 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-bea46a5b-2d9d-4533-95d5-2b16e323d869 admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:29.995972 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-bea46a5b-2d9d-4533-95d5-2b16e323d869 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160403 May 24 13:53:29.996549 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 24 13:53:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:53:30.894433 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:30.895437 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 24 13:53:30.895846 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:53:31.090211 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-4e4758a2-4b4b-4ec9-afe9-a3997d177d6f admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:31.091403 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:53:31.091403 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: warnings.warn(msg) May 24 13:53:31.092611 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-4e4758a2-4b4b-4ec9-afe9-a3997d177d6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:31.093051 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-4e4758a2-4b4b-4ec9-afe9-a3997d177d6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:31.093835 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-4e4758a2-4b4b-4ec9-afe9-a3997d177d6f admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:31.094265 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-4e4758a2-4b4b-4ec9-afe9-a3997d177d6f admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:31.114049 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-4e4758a2-4b4b-4ec9-afe9-a3997d177d6f admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074612 May 24 13:53:31.114525 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 24 13:53:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 13:53:42.371619 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:42.372648 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 24 13:53:42.373032 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:53:42.517752 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_cell0:SELECT=4 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:53:42.518464 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_cell1:SELECT=4 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:53:42.519090 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG dbcounter [-] [103070] Writing DB stats nova_api:SELECT=8 {{(pid=103070) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:53:42.566266 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-67c6eb13-1799-4c06-8250-176298464464 admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:42.567427 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:53:42.567427 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: warnings.warn(msg) May 24 13:53:42.568677 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-67c6eb13-1799-4c06-8250-176298464464 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:42.569119 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-67c6eb13-1799-4c06-8250-176298464464 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:42.569934 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-67c6eb13-1799-4c06-8250-176298464464 admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:42.570368 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-67c6eb13-1799-4c06-8250-176298464464 admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:42.595475 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-67c6eb13-1799-4c06-8250-176298464464 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082543 May 24 13:53:42.596045 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 24 13:53:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:53:43.480736 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: DEBUG nova.api.openstack.wsgi [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] Calling method '>' {{(pid=103069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:43.481741 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: INFO nova.api.openstack.requestlog [None req-df08e0f9-8bb0-4617-afb5-fbef1561e8e3 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 24 13:53:43.482145 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: [pid: 103069|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 24 13:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:53:43.680926 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG nova.api.openstack.wsgi [None req-6a07c640-10dd-4031-91c4-65b7583f22ab admin admin] Calling method '>' {{(pid=103070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:53:43.682095 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 13:53:43.682095 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: warnings.warn(msg) May 24 13:53:43.683270 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-6a07c640-10dd-4031-91c4-65b7583f22ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:43.683704 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-6a07c640-10dd-4031-91c4-65b7583f22ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:43.684516 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-6a07c640-10dd-4031-91c4-65b7583f22ab admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:53:43.684945 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: DEBUG oslo_concurrency.lockutils [None req-6a07c640-10dd-4031-91c4-65b7583f22ab admin admin] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103070) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:53:43.706738 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: INFO nova.api.openstack.requestlog [None req-6a07c640-10dd-4031-91c4-65b7583f22ab admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077157 May 24 13:53:43.707284 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: [pid: 103070|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 24 13:53:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:54:42.957949 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: Tue May 24 13:54:42 2022 - graceful shutdown triggered... May 24 13:54:42.957701 dv-cinder-842129-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 24 13:54:42.958992 dv-cinder-842129-1-iscsi devstack@n-api.service[103070]: Gracefully killing worker 2 (pid: 103070)... May 24 13:54:42.959371 dv-cinder-842129-1-iscsi devstack@n-api.service[103069]: Gracefully killing worker 1 (pid: 103069)... May 24 13:54:43.958532 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: worker 1 buried after 1 seconds May 24 13:54:43.958532 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: worker 2 buried after 1 seconds May 24 13:54:43.958532 dv-cinder-842129-1-iscsi devstack@n-api.service[103068]: goodbye to uWSGI. May 24 13:54:43.960038 dv-cinder-842129-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 24 13:54:43.960600 dv-cinder-842129-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 24 13:54:43.963303 dv-cinder-842129-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 13:54:43.981183 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 13:54:43 2022] *** May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: nodename: dv-cinder-842129-1-iscsi May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: machine: x86_64 May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: clock source: unix May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: pcre jit disabled May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: detected number of CPU cores: 4 May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: current working directory: / May 24 13:54:44.000775 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: detected binary path: /usr/bin/uwsgi-core May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: your processes number limit is 47680 May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: your memory page size is 4096 bytes May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: detected max file descriptor number: 2048 May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: lock engine: pthread robust mutexes May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: thunder lock: enabled May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 13:54:44.001587 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 13:54:44.048678 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: Python main interpreter initialized at 0x55f31c20d9c0 May 24 13:54:44.048678 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: python threads support enabled May 24 13:54:44.048678 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: your server socket listen backlog is limited to 100 connections May 24 13:54:44.048678 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: your mercy for graceful operations on workers is 90 seconds May 24 13:54:44.049119 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: mapped 403077 bytes (393 KB) for 2 cores May 24 13:54:44.049119 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: *** Operational MODE: preforking *** May 24 13:54:44.049373 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: *** uWSGI is running in multiple interpreter mode *** May 24 13:54:44.049373 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: spawned uWSGI master process (pid: 117479) May 24 13:54:44.049583 dv-cinder-842129-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 13:54:44.050310 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: spawned uWSGI worker 1 (pid: 117493, cores: 1) May 24 13:54:44.055056 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: spawned uWSGI worker 2 (pid: 117494, cores: 1) May 24 13:54:44.055056 dv-cinder-842129-1-iscsi devstack@n-api.service[117479]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 13:54:45.242495 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 13:54:45.259483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 13:54:46.046612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:54:46.046612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: from cryptography.utils import int_from_bytes May 24 13:54:46.046941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:54:46.046941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: from cryptography.utils import int_from_bytes May 24 13:54:46.048529 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:54:46.048529 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: from cryptography.utils import int_from_bytes May 24 13:54:46.048871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 13:54:46.048871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: from cryptography.utils import int_from_bytes May 24 13:54:48.518612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 13:54:48.519149 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 13:54:48.519404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 13:54:48.519771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 13:54:48.520062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 13:54:48.520433 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.520768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.521099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.521422 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.521758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.522073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.522399 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.522722 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.523053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.523319 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.523637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.523986 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842129-1-iscsi {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.524313 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.524625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.524938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.525259 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.525570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.525894 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.526204 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.526702 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.528197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.528197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.528197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.528197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.528558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.528806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.529595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.529980 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.530230 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.530518 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.530925 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842129-1-iscsi {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.531233 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.531560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.531892 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.532326 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.532627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.532939 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.533270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.533594 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.533905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.534238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.534565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.534885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.535208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.535512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.535867 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.536158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.536482 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.536792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.537102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.537357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.537672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.537997 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.538323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.538651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.538905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.539158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.539479 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.539803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.540139 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.540450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.540761 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.541072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.541378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.541688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.541995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.542435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.542627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.542947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.543276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.543586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.543930 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.544336 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.545260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.545536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.545828 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.546147 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.546464 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.546786 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.547111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.547431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.547741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.548077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.548403 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.548732 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.549040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.549296 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.549605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.549929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.550240 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.550550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.550860 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.551172 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.551473 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.551787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.552116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.552567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.552737 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.553028 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.553338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.553645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.553952 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.554231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 13:54:48.554727 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.554886 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 13:54:48.555044 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.555044 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.555350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 13:54:48.555508 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.555668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 13:54:48.555866 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.556036 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 13:54:48.556211 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.558900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.559101 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.559271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.559790 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.559990 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.560184 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.560350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.560511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.560669 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.560829 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.560987 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.561143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.561143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.561541 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.561696 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.561872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.562106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.562269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.562269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.562593 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.562896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.563075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.563075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.563381 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842129-1-iscsi {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.563614 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.563769 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.563947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.564106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.564260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.564414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.564578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.564732 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.564890 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565369 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.565827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.566109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.566285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.566433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.566577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.566730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.566888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.567120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.567268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.567421 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.567573 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.567718 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.567893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.568059 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.568213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.568359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.568514 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.568675 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.568833 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.569009 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.569162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.569319 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.569483 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.569956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842129-1-iscsi {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.570127 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.570274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.570431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.570589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.570736 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.570894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.571041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.571195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.571378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.571595 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.571756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.571972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.572151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.572945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.573079 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.573179 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.573257 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.573348 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.573429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.573502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.573583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.573656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.573727 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.573811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.573885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.573956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.574105 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.574261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574332 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.574402 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574479 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.574551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.574713 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.574855 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.574925 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.575002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.575082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.575082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.575230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.575309 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.575390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.575468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.575552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.575632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.575704 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.575704 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.576403 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.576490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.576572 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.576645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.576722 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.576800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.576884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.576958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.577105 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577183 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.577254 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.577417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577495 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.577572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.577783 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.577863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.577945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.578017 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.578099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.578172 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.578256 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.578329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.578406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.578485 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.579353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.579524 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.579690 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.579859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.579859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.580171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.580385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.580578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.580763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.580763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.581063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.581218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.581373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.581530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.581530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.581828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.581984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.582142 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.582298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.582298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.582592 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.582750 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.582750 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.583036 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.583183 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.583342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.583649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.583844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.584000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.584146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.584320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.584741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.584917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.585073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.585221 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.585366 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.585522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.585771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.585925 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.586100 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.586397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.586550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.586712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.586983 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.587139 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.587295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.587529 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.587702 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.587917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.588075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.588317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.588478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.588634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.588791 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.588955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.589127 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.589275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.589429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.589615 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.589801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.589981 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.590144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.590403 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.590609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.590802 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.590964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.591146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.591308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.592182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.592417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.592646 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.592900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.593182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.593382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.593382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.593934 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.594131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.594286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.594460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.594636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.594931 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.595213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.595369 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.595525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.595682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.595876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.596030 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.596191 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.596350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.596497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.596651 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.596797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.596952 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.597107 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.597274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.597431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.597635 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.597795 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.597957 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.598104 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.598251 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.598404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.598551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.598745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.598912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.599059 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.599216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.599370 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.599525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.599680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.599890 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.600056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.600205 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.600349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.600503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.600649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.600808 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.600998 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.601158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.601323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.601480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.601635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.601635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.601931 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.602077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.602223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.602368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.602528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.602686 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.602833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.602979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.603124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.603288 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.603444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.603592 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.603737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.604045 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.604209 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.604367 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.604524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.604671 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.604816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.605129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.605383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 13:54:48.605548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.605722 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.605870 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606023 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606170 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606324 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606481 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606777 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.606929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.607121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.607431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.607598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.607783 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608009 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608159 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608472 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.608947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.609240 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.609396 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.609544 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.609698 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.609863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610010 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610464 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610771 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.610919 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611071 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611852 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611852 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.611852 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.612299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.612446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.612590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.612735 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.612888 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.613036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.613183 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.613336 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.613489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.613650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.613820 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.614127 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.614297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.614445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.614592 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.614738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.614893 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.615060 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.615350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.615611 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.615764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.616157 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.616338 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.616496 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.616643 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.616788 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.616934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617087 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617087 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617375 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.617994 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.618141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.618297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.618443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.618633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.618780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.618948 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.619096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.619248 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.619405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.619552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.619707 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.619887 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620193 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620808 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.620953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.621106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.621259 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.621407 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.621561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.621707 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.621873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.622064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.622222 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.622393 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.622552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.622552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.622870 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.623022 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.623176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.623330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.623562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.623719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.623913 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.624221 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.624381 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.624536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.624707 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.624863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.624863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.625152 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.625450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.625632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.625869 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.626589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.626759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.626915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.627063 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.627229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.627384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.627531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.627805 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.627993 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.628148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.628295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.628448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.628604 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.628760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.628925 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629841 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.629995 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.630150 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.630297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.630297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.631031 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.631199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.631347 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.631509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.631924 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.632099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.632248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.632395 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.632551 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.632706 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.632706 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633147 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633447 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633593 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633748 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.633912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.634535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.634693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.634854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.635000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.635148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.635303 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.635596 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.635751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636026 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636506 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636660 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636814 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.636971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.637120 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.637275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.637431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.637579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.637724 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.637881 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.638035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.638200 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.638886 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.639051 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.639206 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.639374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.639531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.639698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.639914 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.640086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.640241 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.640396 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.640548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.640716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.640881 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.641052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.641292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.641437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.641594 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.641758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.641919 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642081 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642234 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642378 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642508 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.642882 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643370 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643702 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643789 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643789 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.643989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644074 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644261 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644370 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644583 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644677 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644848 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.644932 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645202 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645380 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645904 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.645991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646243 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646699 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646791 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646889 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.646976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647229 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647322 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.647917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648200 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648557 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648652 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648823 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648908 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.648992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.649150 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.649246 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.649467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.649564 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.649779 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.649885 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.650087 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.650181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.650394 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.650495 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.650706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.650814 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.651013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.651322 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.651461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.651625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.651720 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.651972 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.652069 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.652292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.652387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.652601 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.652705 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.652913 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653014 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653832 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.653974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.654198 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.654476 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.654705 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.654938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655127 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655695 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.655959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656157 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.656947 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657048 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657355 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657666 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657877 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.657979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.658186 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.658294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.658502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.658603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.658827 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.658929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.659147 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.659248 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.659461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.659556 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.659775 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.659942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.660113 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.660219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.660439 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.660578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.660758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.660964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.661094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.661429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.661572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.661688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.661857 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.661989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.662191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.662316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.662470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.662592 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.662823 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.662952 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.663142 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.663271 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.663453 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.663581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.663775 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.663932 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.664143 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.664265 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.664453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.664579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.664769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.664896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.665216 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.665533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.665845 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.666163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.666330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.666476 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.666670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.666792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.667013 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.667108 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.667347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.667451 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.667673 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.667767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.668759 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.668905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.669000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.669099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.669198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.669293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.669390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670142 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670573 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670840 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.670934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.671030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.671124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.671218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.671450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.671682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.671833 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.672003 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.672104 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.672443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.672537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.672755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.672863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.673069 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.673165 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.673385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.673487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.673706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.673809 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.674024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.674127 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.674334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.674429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.674757 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.674852 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.675072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.675211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.675386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.675490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.675701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.675801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676191 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.676983 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.677085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.677294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.677390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.677602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.677703 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.677911 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678217 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.678940 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.679143 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.679238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.679465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.679557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.679775 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.679906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.680132 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.680278 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.680444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.680595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.680771 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.680909 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.681086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.681237 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.681528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.681701 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.681846 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.681989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.682159 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.682269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.682477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.682581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.682789 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.682894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.683118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.683221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.683444 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.683548 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.683759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.683885 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.684111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.684206 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.684418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.684525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.684745 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.684838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.685056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.685746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.685947 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.686136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.686263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.686682 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.686885 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.687114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.687227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.687447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.687552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.687768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.687906 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.688120 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.688224 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.688458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.688581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.688770 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.688873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.689076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.689179 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.689390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.689483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.689701 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.689803 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690324 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690417 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.690943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.691047 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.691257 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.691350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.691578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.691710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.691983 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692154 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692643 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.692949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.693178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.693274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.693494 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.693589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.693801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.693894 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.694115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.694217 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.694428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.694528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.694736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.694831 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.695052 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.695145 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.695360 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.695462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.695668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.695794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696610 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.696991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.697211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.697321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.697535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.697629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.697855 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.697957 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.698164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.698276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.698476 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.698577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.698782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.698876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.699090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.699196 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.699402 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.699504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.699713 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.699833 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.700047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.700144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.700355 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.700448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.700661 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.700797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701051 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701151 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701456 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701858 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.701964 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.702115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.702279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.702425 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.702587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.702712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.702915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.703017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.703222 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.703352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.703549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.703656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.703893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704038 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704203 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704673 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704818 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.704999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.705165 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.705318 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.705475 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.705634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.705811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.705952 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.706135 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.706288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.706461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.706553 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.706794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.706923 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.707106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.707247 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.707435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.707556 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.707758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.708111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.708241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.708434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.708552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.708756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.708870 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.709074 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.709174 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.709394 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.709500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.709716 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.709827 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710027 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710133 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710340 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.710971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.711073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.711284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.711535 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.711639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.711964 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.712086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.712282 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.712376 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.712603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.712718 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.712915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713009 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713231 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713544 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713858 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.713965 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.714171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.714272 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.714482 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.714575 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.714791 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.714956 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.715120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.715215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.715436 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.715538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.715748 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.715878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.716116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.716216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.716464 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.716613 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.716789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.716960 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.717194 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.717353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.717586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.717740 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.717951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718364 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718689 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718896 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.718999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.719211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.719304 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.719526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.719728 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.719849 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.719940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.720169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.720263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.720487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.720601 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.720804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.720898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.721117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.721212 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.721430 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.721534 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.721748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.721863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.722071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.722188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.722382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.722510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.722723 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.722994 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.723144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.723310 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.723465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.723608 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.723752 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.723946 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.724097 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.724253 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.724489 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.724594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.724806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.724902 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.725145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.725287 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.725477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.725604 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.725807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.725902 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.726129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.726321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.726450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.726638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.726772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.726979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.727559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.727680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.727780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728194 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728485 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.728667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729325 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729485 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729588 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.729909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.730116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.730340 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.730444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.730693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.730787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.731014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.731117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.731343 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.731440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.731674 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.731777 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.732552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.732738 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.732896 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.733143 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.733321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.733465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.733637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.733794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.733948 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.734125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.734271 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.734438 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.734589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.734749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.734901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.735065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.735211 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.735376 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.735527 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.735687 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.735866 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736171 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736356 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736675 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.736994 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.737158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.737308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.737410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.737617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.737711 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.737926 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738565 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738659 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738892 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.738999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.739201 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.739303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.739510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.739607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.739851 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.739969 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.740175 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.740276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.740503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.740606 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.740808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.740914 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.741115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.741214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.741421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.741514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.741726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.741820 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742173 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742485 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742822 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.742997 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.743101 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.743313 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.743416 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.743624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.743866 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.743974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.744070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.744275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.744383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.744588 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.744691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.744934 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.745029 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.745251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.745425 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.745564 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.745788 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.745891 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.746126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.746222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.746452 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.746548 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.746766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.746870 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.747077 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.747182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.747392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.747504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.747776 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.747930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.748106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.748373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.748501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.748705 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.748825 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749128 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749336 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749753 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.749962 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750074 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750279 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.750996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.751200 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.751364 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.751509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.751651 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.751798 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.751973 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.752125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.752268 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.752409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.752561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.752731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.752915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.753082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.753227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.753407 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.753511 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.753731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.753840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754049 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754151 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754371 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754463 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754682 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.754996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.755090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.755325 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.755682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.755898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.755997 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.756219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.756315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.756539 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.756639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.756858 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.756960 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.757213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.757396 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.757590 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.757728 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.757906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.758046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.758226 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.758363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.758621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.758801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.758956 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.759106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.759251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.759395 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.759536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.759689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.759870 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760316 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.760955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761281 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761510 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761849 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.761999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.762173 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.762581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.762719 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.762855 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.763762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764255 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764346 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764817 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.764912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.765123 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.765227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.765428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.765537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.765735 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.765840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766045 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766455 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766663 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766757 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.766969 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.767067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.767281 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.767468 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.767641 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.767806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.767997 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.768483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.768597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.768762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.768867 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.768964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769052 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769138 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769408 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769660 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769822 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.769964 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.770270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.770372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.770603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.770699 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.770941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.771046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.771258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.771353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.771584 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.771686 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.771921 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.772967 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.773196 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.773312 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.773491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.773597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.773804 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.773906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.774112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.774207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.774434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.774536 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.774746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.774839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.775055 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.775157 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.775366 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.775536 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.775676 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.775769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.776011 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.776245 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.776354 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.776600 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.776703 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.776925 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.777106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.777259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.777415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.777571 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.777795 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.777943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.778095 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.778252 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.778429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.778576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.778716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779157 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779753 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.779926 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780679 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780825 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.780968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.781118 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.781260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.781403 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.781547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.781700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.781877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.782968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.783132 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.783420 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.783604 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.783750 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.783944 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784090 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784817 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.784969 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.785125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.785278 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.785380 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 13:54:48.785591 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.785898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.786211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.786521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.786835 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.787191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.787514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.787848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.788154 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.788472 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.788785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.789111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.789428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.789741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.790094 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.790412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.790952 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.791292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.791620 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.791992 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.792332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.792646 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.792957 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.793273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.793599 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.793916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.794232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.795062 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.795440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.795765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.796111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.796426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.796740 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.797053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.797368 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.797679 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.797997 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.798314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.798662 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.798987 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.799352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.799625 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.799974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.800290 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.800611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.800926 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.801238 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.801558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.801989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.802312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.802623 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.803048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.803367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.803689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.804040 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.804354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.804680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.805010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.805326 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.805652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.805967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.806300 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.806640 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.806972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.807302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.807614 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.807949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.808260 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.808571 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.808892 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.809209 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.809518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.809824 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.810209 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.810532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.810844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.811155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.811465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.811779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.812114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.812425 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.812735 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.813045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.813355 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.813662 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.813973 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.814280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.814589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.814895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.815203 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.815509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.815864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.816210 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.816529 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.816854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.817171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.817498 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.817813 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.818134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.818463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.818779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.819092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.819427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.819741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.820083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.820399 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.820721 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.821035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.821350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.821682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.822012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.822322 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.822652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.822976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.823304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.823626 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.823971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.824305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.824622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.824936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.825261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.825578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.826584 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.826905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.827226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.827559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.827925 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.828241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.828577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.828907 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.829261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.829579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.829930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.830265 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.830586 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.830903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.831220 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 13:54:48.831469 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117494) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 13:54:48.845775 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO dbcounter [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Registered counter for database nova_api May 24 13:54:48.865473 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:48.872974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writer thread running {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:48.891763 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO dbcounter [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Registered counter for database nova_api May 24 13:54:48.912022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_db.sqlalchemy.engines [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:48.919335 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writer thread running {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:48.931015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.context [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d750e084-f072-4f5c-be8b-4cec57d0cd04(cell1) {{(pid=117493) load_cells /opt/stack/nova/nova/context.py:464}} May 24 13:54:48.936036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:54:48.937648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:54:48.938448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:54:48.940497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:54:48.942457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO dbcounter [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Registered counter for database nova_cell0 May 24 13:54:48.946503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO dbcounter [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Registered counter for database nova_cell1 May 24 13:54:48.954266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:48.956480 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:48.961392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writer thread running {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:48.963885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writer thread running {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:48.976959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.context [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d750e084-f072-4f5c-be8b-4cec57d0cd04(cell1) {{(pid=117494) load_cells /opt/stack/nova/nova/context.py:464}} May 24 13:54:48.981119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:54:48.982920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:54:48.983752 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:54:48.985837 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:54:48.987843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO dbcounter [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Registered counter for database nova_cell0 May 24 13:54:48.991836 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO dbcounter [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Registered counter for database nova_cell1 May 24 13:54:48.999585 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_db.sqlalchemy.engines [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:49.001317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_db.sqlalchemy.engines [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:49.007792 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writer thread running {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:49.009083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writer thread running {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:49.116251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO dbcounter [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Registered counter for database nova_cell0 May 24 13:54:49.124294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:49.129038 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writer thread running {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:49.165332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO dbcounter [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Registered counter for database nova_cell0 May 24 13:54:49.172280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_db.sqlalchemy.engines [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117494) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 13:54:49.176689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writer thread running {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 13:54:49.460655 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:54:49.468507 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:54:49.500874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: WARNING keystonemiddleware.auth_token [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:54:49.509721 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: WARNING keystonemiddleware.auth_token [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:54:49.818000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:54:49.824634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-3a169c01-dac2-482d-8f2d-1793e6f75757 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:54:49.830044 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f31c20d9c0 pid: 117493 (default app) May 24 13:54:49.852514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: WARNING keystonemiddleware.auth_token [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 13:54:49.859458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: WARNING keystonemiddleware.auth_token [None req-87d9dc84-bd2b-489b-9c1b-ffb7386250bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 13:54:49.864900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f31c20d9c0 pid: 117494 (default app) May 24 13:55:30.895602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:30.896642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:30.897891 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:30.899277 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:32.553476 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-574dcc51-ce9a-4a57-8880-c0fbdc7b421e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Action: 'create', calling method: .version_select at 0x7f33b7809ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1591457707"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:33.558944 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:33.560861 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:33.563111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:33.566161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:55:35.173309 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-574dcc51-ce9a-4a57-8880-c0fbdc7b421e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.289227 May 24 13:55:35.174262 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1154 bytes} [Tue May 24 13:55:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4292 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 13:55:35.187062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-99bee471-3329-4d37-80cb-55bd00c40359 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b7656c10>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:35.327742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1421965440", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "networks": [{"uuid": "65749181-7f65-4f7b-8fe7-30750c6b382d"}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:35.576576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-99bee471-3329-4d37-80cb-55bd00c40359 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 200 len: 345 microversion: 2.1 time: 0.394366 May 24 13:55:35.577540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 2/2] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 13:55:35 2022] GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 345 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:36.515769 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] validate_networks() for [('65749181-7f65-4f7b-8fe7-30750c6b382d', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:55:36.589941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c3d5878e-52ba-48af-a54b-b7f81dbb30e2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b7656dc0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:36.714150 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c3d5878e-52ba-48af-a54b-b7f81dbb30e2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 200 len: 346 microversion: 2.1 time: 0.127945 May 24 13:55:36.723088 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 3/3] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 13:55:36 2022] GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:55:36.731762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-16c866c9-1ef5-4222-b7a5-706365eab101 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Action: 'create', calling method: .version_select at 0x7f33b7668310>, body: {"snapshot": {"volume_id": "01a2cbac-f662-4ccd-96d4-ae290794999e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2112630170"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:37.291625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-16c866c9-1ef5-4222-b7a5-706365eab101 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.565973 May 24 13:55:37.299429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 4/4] 10.222.0.24 () {60 vars in 1161 bytes} [Tue May 24 13:55:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:37.306321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11415a6c-2234-4f2d-8f4d-61a7ab611e13 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b7668f70>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:37.558753 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-11415a6c-2234-4f2d-8f4d-61a7ab611e13 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.256476 May 24 13:55:37.566468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 5/5] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:37 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:37.579030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ed8ea086-eebc-4f3e-b7aa-3b6dd878e42a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b7668b80>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:37.712107 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ed8ea086-eebc-4f3e-b7aa-3b6dd878e42a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.143775 May 24 13:55:37.713120 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 6/6] 10.222.0.24 () {58 vars in 1139 bytes} [Tue May 24 13:55:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:37.731275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e50c0b7a-5309-4dc8-9a6b-5c0fc0fedc47 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b7656a60>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:37.798719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e50c0b7a-5309-4dc8-9a6b-5c0fc0fedc47 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.072356 May 24 13:55:37.799285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 7/7] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:37 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:55:38.811659 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d6188a9-1e67-4fc1-b63d-597edf406def tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b767a160>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:38.877438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d6188a9-1e67-4fc1-b63d-597edf406def tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.070315 May 24 13:55:38.878172 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 8/8] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:38 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:55:39.135177 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:55:39.136541 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:55:39.136970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:55:39.137501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:55:39.138032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:55:39.168453 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:39.170063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:39.173474 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:39.174616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:39.233323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Getting quotas for project 469bcf4beb3041559397e70538a7ea12. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:55:39.264127 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Getting quotas for user fae3b6e3b2e24719ad90614dc5c7e431 and project 469bcf4beb3041559397e70538a7ea12. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:55:39.301016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:55:39.311648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:55:39.567791 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4e592493-d2c5-496c-8e8c-a2b1a4d17714 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.014829 May 24 13:55:39.579446 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 1/9] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 6024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:55:39.580441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e617afd9-9775-4c28-acd5-cbf9f99e78a3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:39.581462 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e617afd9-9775-4c28-acd5-cbf9f99e78a3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:39.890176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-45be382f-a5c0-4712-afe7-e693c353fb52 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b7603b80>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:39.986023 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e617afd9-9775-4c28-acd5-cbf9f99e78a3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:40.013356 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e617afd9-9775-4c28-acd5-cbf9f99e78a3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1215 microversion: 2.1 time: 0.437164 May 24 13:55:40.015006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 9/10] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:39 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1215 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:40.024449 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-45be382f-a5c0-4712-afe7-e693c353fb52 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.139307 May 24 13:55:40.032053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 2/11] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:39 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:55:41.040204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-716a3c95-b9cd-480a-be28-247577377a92 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b6578790>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:41.045921 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a6d22213-98c1-42e7-bc74-b858758958f9 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:41.059768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a6d22213-98c1-42e7-bc74-b858758958f9 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:41.132172 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-716a3c95-b9cd-480a-be28-247577377a92 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.096235 May 24 13:55:41.134111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 3/12] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:41 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:41.423522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a6d22213-98c1-42e7-bc74-b858758958f9 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:41.432228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a6d22213-98c1-42e7-bc74-b858758958f9 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1215 microversion: 2.1 time: 0.404076 May 24 13:55:41.438112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 10/13] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:41 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1215 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:42.147617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9f6aec0c-43d8-4f61-b698-7ed66e2ef0df tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b6578e50>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:42.218107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9f6aec0c-43d8-4f61-b698-7ed66e2ef0df tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.075395 May 24 13:55:42.219153 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 4/14] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:42 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:42.451739 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:42.452967 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:42.473961 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:42.474431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:42.475323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:42.475642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:42.781005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:42.807093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-940991e1-60e9-4328-8903-c9f623bdcb39 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1219 microversion: 2.1 time: 0.359316 May 24 13:55:42.812046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 11/15] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:42 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1219 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:43.229916 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2703e040-c5c7-4b5d-9fe3-95ea694b37f6 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b75c43a0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:43.303382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2703e040-c5c7-4b5d-9fe3-95ea694b37f6 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 288 microversion: 2.1 time: 0.077225 May 24 13:55:43.304702 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 12/16] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:43 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 288 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:43.318530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-65aec039-d2b0-4026-835d-efa8b675e81e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b75c4b80>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:43.451262 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-65aec039-d2b0-4026-835d-efa8b675e81e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 202 len: 0 microversion: 2.1 time: 0.138574 May 24 13:55:43.451984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 13/17] 10.222.0.24 () {58 vars in 1253 bytes} [Tue May 24 13:55:43 2022] DELETE /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 13:55:43.460361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ba83c8d0-9274-4f5e-9b95-99461f9c7458 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b75c4280>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:43.517711 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ba83c8d0-9274-4f5e-9b95-99461f9c7458 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 200 len: 287 microversion: 2.1 time: 0.061372 May 24 13:55:43.519966 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 14/18] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:43 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:55:43.829335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:43.829943 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:43.843034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:43.843803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:43.844910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:43.845489 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:43.894516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-caeae426-a8dc-4ca6-8eee-fb3cf0bdb538 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: .version_select at 0x7f33b6578dc0>, body: {"keypair": {"name": "tempest-keypair-47875742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIL3Y5E3xgHHTEKp7jXGOHoV1LTyMlD1x7SmvIMobwisUQk53XZQospgiQSQfy73MhF5PQxH88E6iob91Z4c8B8BqMKLV7Fejh6TnuaEk40EhLVLBCd/Xm3A9xoR5IXeHQ=="}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:43.984295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-caeae426-a8dc-4ca6-8eee-fb3cf0bdb538 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:55:44.005723 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-caeae426-a8dc-4ca6-8eee-fb3cf0bdb538 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:55:44.105599 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-caeae426-a8dc-4ca6-8eee-fb3cf0bdb538 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.946932 May 24 13:55:44.106782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 5/19] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 13:55:43 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:44.137638 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:44.160793 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b509711f-d27e-4537-a2dd-fa61a340e1ee tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1285 microversion: 2.1 time: 0.335219 May 24 13:55:44.179148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 15/20] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:43 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1285 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:44.529471 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8abff7b7-d295-4cff-970c-b708b2cf6a33 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b6520280>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:44.586216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-8abff7b7-d295-4cff-970c-b708b2cf6a33 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] HTTP exception thrown: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8abff7b7-d295-4cff-970c-b708b2cf6a33 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Request method failure captured: May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f HTTP/1.1 May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPSYn3qAL0KZpCnng5RNmyaexfEhDTNT4xIFb0p64RZENE52qSiiu--xEpVTmceKZoKoOh7GG_yJL-v9Ow55FDx_zjHF7HbObi9GwBWkUM07wD9MvnZoC7jnJ8uq1R12AQxYzNuvuomi01Ukb78TDyFTr4Y1deNF_g4C_P2LSlFNwY May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:55:44.590513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 2f00eaae5afb48808260a8836f5b4d27 May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': 'a431633e-bca7-4066-86b9-712cfaa4e06f'} May 24 13:55:44.591868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. (HTTP 404) (Request-ID: req-38e262db-2259-4142-823a-f337e8448da0) May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.592638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:44.593751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 24 13:55:44.594754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8abff7b7-d295-4cff-970c-b708b2cf6a33 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Returning 404 to user: Snapshot a431633e-bca7-4066-86b9-712cfaa4e06f could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:44.596063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8abff7b7-d295-4cff-970c-b708b2cf6a33 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f" status: 404 len: 111 microversion: 2.1 time: 0.067194 May 24 13:55:44.596765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 6/21] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 24 13:55:44 2022] GET /compute/v2.1/os-snapshots/a431633e-bca7-4066-86b9-712cfaa4e06f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:55:44.601161 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1b87e8a0-5ee5-4704-ae77-feb0b2499ac1 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b75824c0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:44.774531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1b87e8a0-5ee5-4704-ae77-feb0b2499ac1 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 202 len: 0 microversion: 2.1 time: 0.177584 May 24 13:55:44.775239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 16/22] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 13:55:44 2022] DELETE /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 13:55:44.784586 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ea6c00cb-c3ff-4907-8513-f9a1c62c9774 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b5d03550>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:44.959214 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ea6c00cb-c3ff-4907-8513-f9a1c62c9774 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 200 len: 345 microversion: 2.1 time: 0.179141 May 24 13:55:44.966529 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 7/23] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 13:55:44 2022] GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 345 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:45.183363 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:45.184138 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:45.202477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:45.202931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:45.206965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:45.208440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:45.362199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:45.375950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6c763162-4544-4c7b-9ff4-698fb168fc06 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1273 microversion: 2.1 time: 0.197001 May 24 13:55:45.387766 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 17/24] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:45 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:45.971908 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-38d5d122-59eb-4f87-b5a7-77966d704d3a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b5d03820>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:46.066776 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-38d5d122-59eb-4f87-b5a7-77966d704d3a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] HTTP exception thrown: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-38d5d122-59eb-4f87-b5a7-77966d704d3a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Request method failure captured: May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e HTTP/1.1 May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPSYn3qAL0KZpCnng5RNmyaexfEhDTNT4xIFb0p64RZENE52qSiiu--xEpVTmceKZoKoOh7GG_yJL-v9Ow55FDx_zjHF7HbObi9GwBWkUM07wD9MvnZoC7jnJ8uq1R12AQxYzNuvuomi01Ukb78TDyFTr4Y1deNF_g4C_P2LSlFNwY May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:55:46.069353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 2f00eaae5afb48808260a8836f5b4d27 May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '01a2cbac-f662-4ccd-96d4-ae290794999e'} May 24 13:55:46.071386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. (HTTP 404) (Request-ID: req-abfc2fe9-71cb-42b9-b5b9-9d7a82132352) May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.073509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:46.074487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:55:46.076754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-38d5d122-59eb-4f87-b5a7-77966d704d3a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Returning 404 to user: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-38d5d122-59eb-4f87-b5a7-77966d704d3a tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 404 len: 109 microversion: 2.1 time: 0.102381 May 24 13:55:46.078304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 8/25] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 13:55:45 2022] GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:55:46.081449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-032055be-f276-4a2f-98b3-1a1364b031c2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b750cca0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:46.142805 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-032055be-f276-4a2f-98b3-1a1364b031c2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] HTTP exception thrown: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-032055be-f276-4a2f-98b3-1a1364b031c2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Request method failure captured: May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e HTTP/1.1 May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPSYn3qAL0KZpCnng5RNmyaexfEhDTNT4xIFb0p64RZENE52qSiiu--xEpVTmceKZoKoOh7GG_yJL-v9Ow55FDx_zjHF7HbObi9GwBWkUM07wD9MvnZoC7jnJ8uq1R12AQxYzNuvuomi01Ukb78TDyFTr4Y1deNF_g4C_P2LSlFNwY May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:55:46.152294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 2f00eaae5afb48808260a8836f5b4d27 May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '01a2cbac-f662-4ccd-96d4-ae290794999e'} May 24 13:55:46.153418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. (HTTP 404) (Request-ID: req-c269abe5-bacd-4b86-8825-0aa7142e2785) May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.154105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:55:46.156030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 13:55:46.157487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.158595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.168821 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-032055be-f276-4a2f-98b3-1a1364b031c2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Returning 404 to user: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:46.170778 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-032055be-f276-4a2f-98b3-1a1364b031c2 tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 404 len: 109 microversion: 2.1 time: 0.094251 May 24 13:55:46.184253 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 18/26] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 13:55:46 2022] DELETE /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:55:46.208527 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-823d0a46-2868-43c5-b9fb-dc9613d0db4e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Calling method '.version_select at 0x7f33b75c4dc0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:46.273405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-823d0a46-2868-43c5-b9fb-dc9613d0db4e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] HTTP exception thrown: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-823d0a46-2868-43c5-b9fb-dc9613d0db4e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Request method failure captured: May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e HTTP/1.1 May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPSYn3qAL0KZpCnng5RNmyaexfEhDTNT4xIFb0p64RZENE52qSiiu--xEpVTmceKZoKoOh7GG_yJL-v9Ow55FDx_zjHF7HbObi9GwBWkUM07wD9MvnZoC7jnJ8uq1R12AQxYzNuvuomi01Ukb78TDyFTr4Y1deNF_g4C_P2LSlFNwY May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:55:46.276442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/47cda95585534d33aebb09e4aadfb1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 47cda95585534d33aebb09e4aadfb1fb May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2132388757 May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 2f00eaae5afb48808260a8836f5b4d27 May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2132388757-project May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '01a2cbac-f662-4ccd-96d4-ae290794999e'} May 24 13:55:46.277528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. (HTTP 404) (Request-ID: req-e8dd9626-35da-4380-8bd6-906ee86c035c) May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.278368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:46.279328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:55:46.281143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:46.282432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-823d0a46-2868-43c5-b9fb-dc9613d0db4e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] Returning 404 to user: Volume 01a2cbac-f662-4ccd-96d4-ae290794999e could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:46.284114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-823d0a46-2868-43c5-b9fb-dc9613d0db4e tempest-VolumesSnapshotsTestJSON-2132388757 tempest-VolumesSnapshotsTestJSON-2132388757-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e" status: 404 len: 109 microversion: 2.1 time: 0.098139 May 24 13:55:46.288365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 19/27] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 13:55:46 2022] GET /compute/v2.1/os-volumes/01a2cbac-f662-4ccd-96d4-ae290794999e => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:55:46.401490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:46.402303 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:46.416114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:46.417368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:46.418547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:46.419005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:46.564867 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:46.579336 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e07f1b82-d934-4266-b7e8-dfcfa49e9c11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1273 microversion: 2.1 time: 0.179529 May 24 13:55:46.580351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 20/28] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:46 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:55:46.713062 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-540115686", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:46.798042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] validate_networks() for [('c0e72eb5-e496-4ebe-ba03-7c3c8ffdbca9', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:55:47.598797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:47.599419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:47.619132 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:47.623168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:47.624079 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:47.627976 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:48.544603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:48.552536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-787783ef-8feb-4560-9619-aab9c38c9e0a tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.957628 May 24 13:55:48.555953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 21/29] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:47 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:55:48.742724 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:55:48.744160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:55:48.745350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:55:48.745984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:55:48.746550 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:55:48.776632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:48.777155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:48.778167 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:48.778620 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:48.839257 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for project 54ee7d13408645e6b6517f541fe45670. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:55:48.849845 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for user 532b36f272dc432aad6faa294bd1bc6c and project 54ee7d13408645e6b6517f541fe45670. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:55:48.890711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:55:48.897322 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:55:49.055120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f952aef7-ab01-4c3c-bb99-a501a4ad26db tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.935446 May 24 13:55:49.055778 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 9/30] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:55:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 13:55:49.068045 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e8761f43-64fb-4620-8c58-55fd1500fbf6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:49.068668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e8761f43-64fb-4620-8c58-55fd1500fbf6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:49.274573 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e8761f43-64fb-4620-8c58-55fd1500fbf6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:49.287329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e8761f43-64fb-4620-8c58-55fd1500fbf6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1221 microversion: 2.1 time: 0.220600 May 24 13:55:49.290069 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 22/31] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:49 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:49.577551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:49.578188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:49.607122 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:49.607594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:49.608426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:49.608870 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:50.070787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-888565564", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:50.287942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] validate_networks() for [('c0e72eb5-e496-4ebe-ba03-7c3c8ffdbca9', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:55:50.686278 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:50.715923 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-82fc1781-9fff-480f-8a9a-0042d597480b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 1.147201 May 24 13:55:50.716530 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 10/32] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:49 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:51.119056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1777161755", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e5782d9-5791-4763-85b4-bfd8289d9060"}], "security_groups": [{"name": "tempest-securitygroup--428405128"}], "key_name": "tempest-keypair-47875742", "user_data": "}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:51.693337 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] validate_networks() for [('2e5782d9-5791-4763-85b4-bfd8289d9060', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:55:52.931553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:55:52.932905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:55:52.933689 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:55:52.934351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:55:52.935099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:55:52.975434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:52.976299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:52.977445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:52.978255 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:53.031362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:55:53.031959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:55:53.032558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:55:53.033181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:55:53.033691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:55:53.063274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for project 54ee7d13408645e6b6517f541fe45670. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:55:53.073072 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:53.075550 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:53.075738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for user 532b36f272dc432aad6faa294bd1bc6c and project 54ee7d13408645e6b6517f541fe45670. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:55:53.079131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:53.080605 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:53.112386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:55:53.115799 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:55:53.161055 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:55:53.169912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:55:53.246281 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:55:53.256737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:55:53.289405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e16c34d7-7254-408a-9246-02f1d46b7825 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.223052 May 24 13:55:53.290440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 23/33] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:55:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:55:53.301243 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:53.309138 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:53.335102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:53.339981 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:53.341121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:53.346438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:53.412546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-51088292-f074-4fe4-9a10-4b5855b541b1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.298381 May 24 13:55:53.424122 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 11/34] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:55:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:55:54.160108 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-82020cfd-463a-434d-a925-bcf2a1a8d82f tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Action: 'create', calling method: .version_select at 0x7f33b5c44700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-239359046", "metadata": {"Type": "work"}}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-82020cfd-463a-434d-a925-bcf2a1a8d82f tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Request method failure captured: May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 121 May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPo-E5dfCjcc3nUFONTaeKZyLnA2fWSkPnJMV2XJMWzWgnssTOrlEP5gMXZ1BIwQ3vTEIrCgyLQ4b1pJ_KxNRU3yWyL66Vbfk73Rkt0KQMjaJSxcJt2tMgZCzcCDcprsq7b-5uiFtFJQnw9tnUNsnA0EKx4sGosUrwjwYmehHtouuE May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:55:54.227637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesNegativeTest-471549054-project May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: c812cde8c08445ab8cde8d96a46f314c May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesNegativeTest-471549054-project May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-239359046", "metadata": {"Type": "work"}}} May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 13:55:54.228841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-239359046', 'metadata': {'Type': 'work'}}}} May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise error May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi '#$%' May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:54.229649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 13:55:54.230793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 13:55:54.235550 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 13:55:54.235550 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.240721 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-82020cfd-463a-434d-a925-bcf2a1a8d82f tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:54.243469 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-82020cfd-463a-434d-a925-bcf2a1a8d82f tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.823993 May 24 13:55:54.244842 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 12/35] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 24 13:55:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 827 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 13:55:54.261111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ca424c3e-6739-44d1-b03c-d15978912962 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:54.267043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ca424c3e-6739-44d1-b03c-d15978912962 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:54.586025 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ca424c3e-6739-44d1-b03c-d15978912962 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:54.610577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ca424c3e-6739-44d1-b03c-d15978912962 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1221 microversion: 2.1 time: 0.357497 May 24 13:55:54.611797 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 13/36] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:54 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1221 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:54.624682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86e2def7-1eca-4138-8443-8a09a19999cf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:54.627864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-86e2def7-1eca-4138-8443-8a09a19999cf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:54.758290 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:54.769429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-31664c60-c9e3-4d09-bb08-caa302d59101 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 1.472592 May 24 13:55:54.775103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-86e2def7-1eca-4138-8443-8a09a19999cf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:54.777339 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 24/37] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:53 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:54.782602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4f0e84d3-08d8-411a-bbae-868190be12c8 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Action: 'create', calling method: .version_select at 0x7f33b6bd7ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-902094107", "metadata": {"Type": "work"}}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:54.785007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-86e2def7-1eca-4138-8443-8a09a19999cf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1240 microversion: 2.1 time: 0.171777 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4f0e84d3-08d8-411a-bbae-868190be12c8 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Request method failure captured: May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 119 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPo-E5dfCjcc3nUFONTaeKZyLnA2fWSkPnJMV2XJMWzWgnssTOrlEP5gMXZ1BIwQ3vTEIrCgyLQ4b1pJ_KxNRU3yWyL66Vbfk73Rkt0KQMjaJSxcJt2tMgZCzcCDcprsq7b-5uiFtFJQnw9tnUNsnA0EKx4sGosUrwjwYmehHtouuE May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:55:54.786565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesNegativeTest-471549054-project May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: c812cde8c08445ab8cde8d96a46f314c May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesNegativeTest-471549054-project May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-902094107", "metadata": {"Type": "work"}}} May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: May 24 13:55:54.798177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-902094107', 'metadata': {'Type': 'work'}}}} May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise error May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi '0' May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:54.798965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 13:55:54.800414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 13:55:54.801425 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 13:55:54.801425 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:54.801617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 14/38] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:54 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1240 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:54.810189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4f0e84d3-08d8-411a-bbae-868190be12c8 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:54.811517 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4f0e84d3-08d8-411a-bbae-868190be12c8 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033051 May 24 13:55:54.813399 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 25/39] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 24 13:55:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 13:55:54.824188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-64820b8a-bd13-4a15-89f0-4de95deb2bb2 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Action: 'create', calling method: .version_select at 0x7f33b5b8daf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-782824481", "metadata": {"Type": "work"}}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-64820b8a-bd13-4a15-89f0-4de95deb2bb2 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Request method failure captured: May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 118 May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPo-E5dfCjcc3nUFONTaeKZyLnA2fWSkPnJMV2XJMWzWgnssTOrlEP5gMXZ1BIwQ3vTEIrCgyLQ4b1pJ_KxNRU3yWyL66Vbfk73Rkt0KQMjaJSxcJt2tMgZCzcCDcprsq7b-5uiFtFJQnw9tnUNsnA0EKx4sGosUrwjwYmehHtouuE May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:55:54.826875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesNegativeTest-471549054-project May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: c812cde8c08445ab8cde8d96a46f314c May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesNegativeTest-471549054-project May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-782824481", "metadata": {"Type": "work"}}} May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 13:55:54.828598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-782824481', 'metadata': {'Type': 'work'}}}} May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise error May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi '' May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:54.829463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 13:55:54.830546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 13:55:54.833762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 13:55:54.833762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:54.833762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-64820b8a-bd13-4a15-89f0-4de95deb2bb2 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:54.833762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-64820b8a-bd13-4a15-89f0-4de95deb2bb2 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009676 May 24 13:55:54.833762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 15/40] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 24 13:55:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 13:55:54.838149 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d59122f3-6fc5-42af-ae31-a7885a2e8ecf tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Calling method '.version_select at 0x7f33b6be54c0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:55.100850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-d59122f3-6fc5-42af-ae31-a7885a2e8ecf tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] HTTP exception thrown: Volume tempest-invalid-1452822044 could not be found. May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d59122f3-6fc5-42af-ae31-a7885a2e8ecf tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Request method failure captured: May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1452822044 HTTP/1.1 May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPo-E5dfCjcc3nUFONTaeKZyLnA2fWSkPnJMV2XJMWzWgnssTOrlEP5gMXZ1BIwQ3vTEIrCgyLQ4b1pJ_KxNRU3yWyL66Vbfk73Rkt0KQMjaJSxcJt2tMgZCzcCDcprsq7b-5uiFtFJQnw9tnUNsnA0EKx4sGosUrwjwYmehHtouuE May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:55:55.101457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesNegativeTest-471549054-project May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: c812cde8c08445ab8cde8d96a46f314c May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesNegativeTest-471549054-project May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Volume tempest-invalid-1452822044 could not be found. May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'tempest-invalid-1452822044'} May 24 13:55:55.102629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1452822044 could not be found. (HTTP 404) (Request-ID: req-fbb5f44a-cd11-44ac-9505-cf148ca25d24) May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.103604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:55:55.105469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1452822044 could not be found. May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:55.106446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1452822044 could not be found. May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1452822044 could not be found. May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d59122f3-6fc5-42af-ae31-a7885a2e8ecf tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Returning 404 to user: Volume tempest-invalid-1452822044 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d59122f3-6fc5-42af-ae31-a7885a2e8ecf tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1452822044" status: 404 len: 99 microversion: 2.1 time: 0.269199 May 24 13:55:55.109141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 26/41] 10.222.0.24 () {58 vars in 1217 bytes} [Tue May 24 13:55:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1452822044 => generated 99 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 24 13:55:55.121405 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7bfd5f5c-8e4a-474b-9a88-527f567d9f52 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011931 May 24 13:55:55.124598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 16/42] 10.222.0.24 () {58 vars in 1139 bytes} [Tue May 24 13:55:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 13:55:55.135615 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4798d87c-5d82-46c5-902b-cdced559a06d tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004743 May 24 13:55:55.137405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 27/43] 10.222.0.24 () {58 vars in 1136 bytes} [Tue May 24 13:55:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 13:55:55.146658 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-aeec4072-606d-4294-b0d9-4a4074e26e35 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Calling method '.version_select at 0x7f33b5ca2a60>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:55.325600 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-aeec4072-606d-4294-b0d9-4a4074e26e35 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] HTTP exception thrown: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-aeec4072-606d-4294-b0d9-4a4074e26e35 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Request method failure captured: May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/os-volumes/79bb937a-9763-4d20-abfd-e1e003ff386a HTTP/1.1 May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPo-E5dfCjcc3nUFONTaeKZyLnA2fWSkPnJMV2XJMWzWgnssTOrlEP5gMXZ1BIwQ3vTEIrCgyLQ4b1pJ_KxNRU3yWyL66Vbfk73Rkt0KQMjaJSxcJt2tMgZCzcCDcprsq7b-5uiFtFJQnw9tnUNsnA0EKx4sGosUrwjwYmehHtouuE May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:55:55.328233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesNegativeTest-471549054-project May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: c812cde8c08445ab8cde8d96a46f314c May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesNegativeTest-471549054-project May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '79bb937a-9763-4d20-abfd-e1e003ff386a'} May 24 13:55:55.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. (HTTP 404) (Request-ID: req-61da2631-8831-4587-8a27-92c622d4ce10) May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.330343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 13:55:55.336141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 13:55:55.338053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-aeec4072-606d-4294-b0d9-4a4074e26e35 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Returning 404 to user: Volume 79bb937a-9763-4d20-abfd-e1e003ff386a could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-aeec4072-606d-4294-b0d9-4a4074e26e35 tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/79bb937a-9763-4d20-abfd-e1e003ff386a" status: 404 len: 109 microversion: 2.1 time: 0.187674 May 24 13:55:55.339199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 17/44] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 13:55:55 2022] DELETE /compute/v2.1/os-volumes/79bb937a-9763-4d20-abfd-e1e003ff386a => generated 109 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 13:55:55.343042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e42f3697-6fb9-4733-bec2-717b73621bec tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Calling method '.version_select at 0x7f33b5b8d0d0>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:55.477019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-a099b7b9-c411-447b-9a04-1a55af006b2e req-b67673db-769a-4130-934a-ad56363e97ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dd759e-f58f-4459-b7da-0cb782f87e6d", "tag": "56936aaa-5166-4c7c-8b7c-5354a85bc313"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:55:55.531742 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-a099b7b9-c411-447b-9a04-1a55af006b2e req-b67673db-769a-4130-934a-ad56363e97ad service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.532291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-a099b7b9-c411-447b-9a04-1a55af006b2e req-b67673db-769a-4130-934a-ad56363e97ad service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.545353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-e42f3697-6fb9-4733-bec2-717b73621bec tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] HTTP exception thrown: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e42f3697-6fb9-4733-bec2-717b73621bec tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Request method failure captured: May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/os-volumes/6e6ec870-24eb-47bb-b1e4-a0df84be884f HTTP/1.1 May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPo-E5dfCjcc3nUFONTaeKZyLnA2fWSkPnJMV2XJMWzWgnssTOrlEP5gMXZ1BIwQ3vTEIrCgyLQ4b1pJ_KxNRU3yWyL66Vbfk73Rkt0KQMjaJSxcJt2tMgZCzcCDcprsq7b-5uiFtFJQnw9tnUNsnA0EKx4sGosUrwjwYmehHtouuE May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:55:55.547440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/40eb072e6b8348e2bd1c58ce421983d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 40eb072e6b8348e2bd1c58ce421983d2 May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesNegativeTest-471549054 May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesNegativeTest-471549054-project May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: c812cde8c08445ab8cde8d96a46f314c May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesNegativeTest-471549054-project May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '6e6ec870-24eb-47bb-b1e4-a0df84be884f'} May 24 13:55:55.548854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. (HTTP 404) (Request-ID: req-f057bd2a-3434-4f4d-b425-b5c6be5a593c) May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.549506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 13:55:55.550607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 13:55:55.551609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e42f3697-6fb9-4733-bec2-717b73621bec tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] Returning 404 to user: Volume 6e6ec870-24eb-47bb-b1e4-a0df84be884f could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e42f3697-6fb9-4733-bec2-717b73621bec tempest-VolumesNegativeTest-471549054 tempest-VolumesNegativeTest-471549054-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/6e6ec870-24eb-47bb-b1e4-a0df84be884f" status: 404 len: 109 microversion: 2.1 time: 0.212253 May 24 13:55:55.552543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 18/45] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 13:55:55 2022] GET /compute/v2.1/os-volumes/6e6ec870-24eb-47bb-b1e4-a0df84be884f => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 13:55:55.578037 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-a099b7b9-c411-447b-9a04-1a55af006b2e req-b67673db-769a-4130-934a-ad56363e97ad service nova] Creating event network-changed:56936aaa-5166-4c7c-8b7c-5354a85bc313 for instance 62dd759e-f58f-4459-b7da-0cb782f87e6d on hv-cinder-84212 May 24 13:55:55.580306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-a099b7b9-c411-447b-9a04-1a55af006b2e req-b67673db-769a-4130-934a-ad56363e97ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=117493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 13:55:55.581754 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.582404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.583389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.584136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.604118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.compute.rpcapi [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 13:55:55.605377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] Releasing lock "compute-rpcapi-router" {{(pid=117493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 13:55:55.643174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:55.643174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:55.643556 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2b8f4b0f-c338-4b97-8c20-e96043c5b6be None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325637 May 24 13:55:55.643556 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 28/46] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:55:55.654241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.657097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.659624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.662761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.789343 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:55.790783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:55.814063 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.815232 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.821063 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.821785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.850719 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:55.861916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c0fe0db9-97c7-4e7a-830f-74bdb9924fe8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1273 microversion: 2.1 time: 0.237251 May 24 13:55:55.869188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 19/47] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:55 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:55.890870 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:55.893235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:55.902888 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.903669 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:55.904887 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:55.905685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:56.025067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:56.049236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-96fafb98-79d0-46de-a295-5bceb906e43d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1236 microversion: 2.1 time: 0.178716 May 24 13:55:56.069709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 20/48] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:55 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1236 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:56.543871 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:56.553921 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c384ac6f-53ee-436e-83d6-5d4dd9f84da2 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.769265 May 24 13:55:56.558785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 29/49] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:55 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:55:56.902470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:56.907223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:56.943148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:56.944116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:56.945297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:56.945974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:57.076700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:57.077430 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:57.094313 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:57.094772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:57.095762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:57.096286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:57.368765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:57.390953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7af6fa42-d329-47ef-b1a7-2b6e62c30ea2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1300 microversion: 2.1 time: 0.314062 May 24 13:55:57.392968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 30/50] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:57 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1300 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:57.490842 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:57.526071 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7f82e016-7c43-4013-999d-7425c441d381 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1279 microversion: 2.1 time: 0.627086 May 24 13:55:57.527986 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 21/51] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:56 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1279 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:57.575707 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:57.576755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:57.590080 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:57.594269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:57.595337 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:57.596128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:58.411193 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:58.412523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:58.435490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:58.436379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:58.437391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:58.438032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:58.722915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:58.733298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1156cf4d-c0a2-46ae-82ef-dfd16302fe37 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 1.162376 May 24 13:55:58.737405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 31/52] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:57 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:58.750389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:58.752612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:58.756741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:58.764812 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8ad560c3-d9af-4e14-b02a-edb6a18fd66e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1298 microversion: 2.1 time: 0.357635 May 24 13:55:58.766340 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 22/53] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:58 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1298 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:58.779139 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:58.783589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:58.786577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:58.788493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:59.038567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:55:59.047938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5d7aef23-1557-4da2-bfb6-be5892745ff2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1279 microversion: 2.1 time: 0.309108 May 24 13:55:59.062143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 32/54] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:58 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1279 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:55:59.755267 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:59.756001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:59.775527 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:59.777606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:59.785477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:55:59.786420 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:55:59.793325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:59.801006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:59.806353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:59.812927 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:55:59.816678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:55:59.817461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:00.209668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:00.233403 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a1ed911f-03d8-4bfe-b7ad-ef3e22146e9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1298 microversion: 2.1 time: 0.441990 May 24 13:56:00.244769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 33/55] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:59 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1298 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:00.250418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:00.251339 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:00.264922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:00.265675 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:00.269464 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:00.270259 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:00.496656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:00.512163 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ba122feb-e580-4890-936c-3ebde952b4ba tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.761399 May 24 13:56:00.513068 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 23/56] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:55:59 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:01.250851 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:01.251609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:01.262819 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:01.272637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:01.276048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:01.276831 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:01.507047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:01.527775 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a5c4cc6a-7423-4a65-8374-2febf34effe6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1298 microversion: 2.1 time: 0.278206 May 24 13:56:01.530144 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 24/57] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:01 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1298 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:01.542122 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:01.545665 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:01.566100 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:01.576517 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:01.577543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:01.578221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:01.588489 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:01.605550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b8261b88-647c-4214-adb0-88c891ed1524 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 1.364893 May 24 13:56:01.607339 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 34/58] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:00 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:02.232239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:02.240424 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-50ff5bc0-7a4e-4e81-92dc-d35f3befbcf5 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.708932 May 24 13:56:02.241238 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 25/59] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:01 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:02.548198 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:02.548804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:02.552821 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:02.565044 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:02.565493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:02.566260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:02.566781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:02.624910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:02.627060 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:02.660501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:02.667049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:02.668669 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:02.674939 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:03.098229 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=12 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:03.120000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:03.177784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:03.188669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a604fb7b-f561-4f4b-ae01-84d1c115b22d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.645219 May 24 13:56:03.207393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 35/60] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:02 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:03.214713 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-be73e96c-89af-4040-ad85-c8b9d9954862 req-dc641a74-056c-4ee4-ac37-0f1187041c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f19875e-64fa-4a59-9a45-a3d6e7ae96d6", "tag": "b953d341-a6ef-44a5-b545-6c5db2385fb4"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:03.232166 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-be73e96c-89af-4040-ad85-c8b9d9954862 req-dc641a74-056c-4ee4-ac37-0f1187041c8c service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:03.236248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-be73e96c-89af-4040-ad85-c8b9d9954862 req-dc641a74-056c-4ee4-ac37-0f1187041c8c service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:03.262633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:03.267552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-be73e96c-89af-4040-ad85-c8b9d9954862 req-dc641a74-056c-4ee4-ac37-0f1187041c8c service nova] Creating event network-changed:b953d341-a6ef-44a5-b545-6c5db2385fb4 for instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 on hv-cinder-84212 May 24 13:56:03.277537 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-be73e96c-89af-4040-ad85-c8b9d9954862 req-dc641a74-056c-4ee4-ac37-0f1187041c8c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068767 May 24 13:56:03.278455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 36/61] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:03.291396 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:03.292400 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:03.311099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-158b1d6e-033b-475a-a16e-011af5e90e17 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.687940 May 24 13:56:03.317226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 26/62] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:02 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:03.325438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:03.325438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:03.326062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:03.327114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:03.579136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:03.591602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-54bd0f2c-02f6-41f9-8c9a-972920774029 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.311903 May 24 13:56:03.601131 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 37/63] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:03 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:04.168726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-31b7356e-e232-42b7-99a4-ba2731b6b6b2 req-5a06a39d-6344-4c3a-9bd5-f7b338885a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f67703-35a4-40ad-a442-d8230c57ca65", "tag": "962017d2-ce45-4701-b48a-e3e4aa4836f5"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:04.174195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:04.196004 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-31b7356e-e232-42b7-99a4-ba2731b6b6b2 req-5a06a39d-6344-4c3a-9bd5-f7b338885a63 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.197815 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-31b7356e-e232-42b7-99a4-ba2731b6b6b2 req-5a06a39d-6344-4c3a-9bd5-f7b338885a63 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.215782 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:04.216428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:04.229730 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.230288 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.234173 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.234173 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.241400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=61 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:04.269815 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-31b7356e-e232-42b7-99a4-ba2731b6b6b2 req-5a06a39d-6344-4c3a-9bd5-f7b338885a63 service nova] Creating event network-changed:962017d2-ce45-4701-b48a-e3e4aa4836f5 for instance 84f67703-35a4-40ad-a442-d8230c57ca65 on hv-cinder-84212 May 24 13:56:04.271384 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-31b7356e-e232-42b7-99a4-ba2731b6b6b2 req-5a06a39d-6344-4c3a-9bd5-f7b338885a63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 13:56:04.275870 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.277684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.278985 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.280850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.296142 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.compute.rpcapi [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 13:56:04.297049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] Releasing lock "compute-rpcapi-router" {{(pid=117494) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 13:56:04.347438 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9dacda81-f8dc-4823-b3ec-a878b5c1564a None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.654583 May 24 13:56:04.348454 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 27/64] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:04.361428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:04.362240 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:04.387086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.387557 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.391569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.392271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.612110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:04.625875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9631ce02-6114-4843-bb4d-be07a23ffec8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.276114 May 24 13:56:04.626654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 28/65] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:04 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:04.643897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:04.644435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:04.660736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.661073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.661905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:04.662347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:04.782256 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=26 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:04.886050 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:04.909788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-18d6e11c-c993-4fd3-bd31-d4864a333244 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.281748 May 24 13:56:04.914674 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:04.927502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 29/66] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:04 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:04.930474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3d22593e-1793-481f-9fcd-2a98d30a57c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.719831 May 24 13:56:04.935790 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 38/67] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:04 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:05.597522 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-9a9d8bb5-6d0a-479d-a3d3-bf49adea3ea2 req-114a25d5-c2b2-49b8-9e3d-ca57b36bf822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9302a225-a5b2-456b-97ef-a6c329608645", "tag": "52d23d1f-444b-41aa-8726-0248ab97db05"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:05.614711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-9a9d8bb5-6d0a-479d-a3d3-bf49adea3ea2 req-114a25d5-c2b2-49b8-9e3d-ca57b36bf822 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.615263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-9a9d8bb5-6d0a-479d-a3d3-bf49adea3ea2 req-114a25d5-c2b2-49b8-9e3d-ca57b36bf822 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:05.644923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:05.646771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:05.648863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=4 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:05.664478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.676249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-9a9d8bb5-6d0a-479d-a3d3-bf49adea3ea2 req-114a25d5-c2b2-49b8-9e3d-ca57b36bf822 service nova] Creating event network-changed:52d23d1f-444b-41aa-8726-0248ab97db05 for instance 9302a225-a5b2-456b-97ef-a6c329608645 on hv-cinder-84212 May 24 13:56:05.677995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:05.680546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.682840 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:05.700648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-9a9d8bb5-6d0a-479d-a3d3-bf49adea3ea2 req-114a25d5-c2b2-49b8-9e3d-ca57b36bf822 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104332 May 24 13:56:05.704862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 30/68] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:05.708412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:05.897717 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:05.905719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-146e7be8-7bb3-4e0c-bff0-ba7eae71d0cd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.266211 May 24 13:56:05.906312 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 39/69] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:05 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:05.951383 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:05.954420 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:05.955303 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:05.956897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:05.968639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.970325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.970933 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:05.971904 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.972345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:05.976883 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:05.977641 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:05.978625 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:06.162418 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:06.171117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9059e18d-8c41-41b1-9a5e-d985db7fb8c7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.226289 May 24 13:56:06.181622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 31/70] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:05 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:06.184503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:06.191792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d7bdc94a-3518-4549-9364-6d6203e894f7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.244112 May 24 13:56:06.192415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 40/71] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:05 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:06.925492 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:06.926114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:06.938137 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:06.939843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:06.940824 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:06.941445 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:07.142289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:07.154485 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0a3bfc01-e8ce-4d8b-8739-1861862752cb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.232760 May 24 13:56:07.155137 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 32/72] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:06 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:07.187949 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:07.188567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:07.195557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:07.196047 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:07.197534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:07.197978 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:07.210365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:07.211912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:07.219078 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:07.219721 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:07.220696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:07.221286 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:07.364043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:07.375715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4744b33d-eccf-4557-8dc7-aeec904aa19f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.191580 May 24 13:56:07.386876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 41/73] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:07 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:07.390039 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:07.398184 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0f653d7f-ef71-4865-9116-2dbb03fc3e18 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.191917 May 24 13:56:07.398867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 33/74] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:07 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:08.170459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:08.171073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:08.178106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:08.178586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:08.179397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:08.179889 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:08.313709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:08.321709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c234954d-be82-473b-9e93-1de7a0ae84c4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.154874 May 24 13:56:08.322420 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 42/75] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:08 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:08.393630 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:08.394328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:08.401180 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:08.401642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:08.402450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:08.402916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:08.415986 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:08.417086 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:08.424227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:08.424686 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:08.425461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:08.426110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:08.562097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:08.570105 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-47ce6908-e136-450c-a4c3-b9461a79f63f tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.180316 May 24 13:56:08.570702 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 34/76] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:08 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:08.585067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:08.593432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6742bb6a-36d0-43fe-baa4-2656861e598c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.182114 May 24 13:56:08.594005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 43/77] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:08 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:09.339193 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:09.339754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:09.345758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:09.346210 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:09.346975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:09.347416 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:09.485473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:09.493955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-20e54e60-cad6-4024-990d-d74634e52a3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.158164 May 24 13:56:09.494134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 35/78] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:09 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:09.586332 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:09.587506 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:09.593940 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:09.594531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:09.595498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:09.596097 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:09.617043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:09.617884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:09.624727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:09.625182 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:09.626347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:09.626932 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:09.734486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:09.749557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5edac934-8211-4fe3-99aa-5696ea4e445c tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.165764 May 24 13:56:09.750823 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 44/79] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:09 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:09.791287 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:09.799508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ca2680fc-1704-4896-8bff-98797d18a207 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.193358 May 24 13:56:09.800116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 36/80] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:09 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:10.511560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:10.512439 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:10.518741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:10.519247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:10.520045 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:10.520485 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:10.673768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:10.682297 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-63870fee-02d2-41f3-97d1-b35f7558fac1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.175581 May 24 13:56:10.682883 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 45/81] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:10 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:10.768876 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:10.769423 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:10.776480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:10.777178 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:10.778082 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:10.778519 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:10.824832 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:10.825454 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:10.832589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:10.833609 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:10.834460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:10.834897 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:11.029814 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:11.037685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5994e293-0b44-4b56-b44a-204e5debb95b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.272864 May 24 13:56:11.048230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 37/82] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:10 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:11.253754 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:11.261635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4212619d-78e2-45f2-b4e0-3b2fd1761573 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.448483 May 24 13:56:11.271000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 46/83] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:10 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:11.700467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:11.701486 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:11.708520 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:11.709004 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:11.709836 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:11.710342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:11.888508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:11.898229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5d357e87-3b2c-4af1-918c-0cab8bb985c5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.202505 May 24 13:56:11.899413 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 38/84] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:11 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:12.054433 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:12.055096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:12.062033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:12.062480 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:12.063246 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:12.063681 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:12.216847 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:12.224793 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1efc5390-009c-40f1-b6c9-e9f8059af712 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.174089 May 24 13:56:12.236306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 47/85] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:12 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:12.277912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:12.278683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:12.285192 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:12.285968 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:12.286938 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:12.287523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:12.440185 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:12.450489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3fd19855-2195-4c19-bde7-77c1cbd0e77e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.176375 May 24 13:56:12.451189 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 39/86] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:12 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:12.914697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:12.916166 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:12.922153 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:12.922833 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:12.923377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:12.923835 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:13.069326 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:13.078225 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-93b6633f-6a2d-44a0-a02c-3d9c48dba25c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.167197 May 24 13:56:13.078810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 48/87] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:12 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:13.245577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:13.246202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:13.253164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:13.253698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:13.254839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:13.255588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:13.428678 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:13.439246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1c0fffee-f971-4d8d-85d3-bf64a82f953e tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.200364 May 24 13:56:13.439843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 40/88] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:13 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:13.466914 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:13.467698 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:13.474813 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:13.475450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:13.476569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:13.476988 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:13.661559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:13.681301 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0a6b2999-936a-45d6-b15d-9a7b0213beaf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.215033 May 24 13:56:13.688052 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 49/89] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:13 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:13.794910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-0d6bae22-2fca-442d-adf8-dd3851ca690c req-edcdddd8-4ae0-4c5a-b4ba-7e8932e2652e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dd759e-f58f-4459-b7da-0cb782f87e6d", "name": "network-vif-plugged", "status": "completed", "tag": "56936aaa-5166-4c7c-8b7c-5354a85bc313"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:13.811337 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0d6bae22-2fca-442d-adf8-dd3851ca690c req-edcdddd8-4ae0-4c5a-b4ba-7e8932e2652e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:13.812094 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0d6bae22-2fca-442d-adf8-dd3851ca690c req-edcdddd8-4ae0-4c5a-b4ba-7e8932e2652e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:13.829905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-0d6bae22-2fca-442d-adf8-dd3851ca690c req-edcdddd8-4ae0-4c5a-b4ba-7e8932e2652e service nova] Creating event network-vif-plugged:56936aaa-5166-4c7c-8b7c-5354a85bc313 for instance 62dd759e-f58f-4459-b7da-0cb782f87e6d on hv-cinder-84212 May 24 13:56:13.837067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-0d6bae22-2fca-442d-adf8-dd3851ca690c req-edcdddd8-4ae0-4c5a-b4ba-7e8932e2652e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111297 May 24 13:56:13.838185 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 41/90] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:14.095564 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:14.096537 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:14.108560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:14.109125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:14.110150 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:14.110688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:14.455161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:14.460279 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:14.463105 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:14.492519 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:14.497477 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:14.498421 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:14.498879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:15.047323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:15.056834 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-47edbbdf-af4d-4709-b7af-6920e1bf208b tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.602681 May 24 13:56:15.057941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 42/91] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:14 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:15.063251 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:15.064222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:15.072865 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:15.073856 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:15.075539 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:15.076427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:15.158772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:15.168461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5ad8bbdd-d207-4022-9153-6151cd910e3f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 1.077239 May 24 13:56:15.169283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 50/92] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:14 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:15.418602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:15.426182 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0e67d5a2-d75e-41bc-b0b5-0a0322105adf tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.367018 May 24 13:56:15.446469 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 43/93] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:15 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:16.074568 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:16.075951 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:16.084007 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:16.084791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:16.088075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:16.088715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:16.187456 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:16.188306 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:16.204246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:16.212246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:16.215433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:16.216852 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:16.445154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:16.449549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:16.457515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-10c8b2cd-d039-4018-a7e8-c031206f1874 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.385961 May 24 13:56:16.458922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 51/94] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:16 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:16.461283 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2e7726dd-b0ec-42d5-a7a0-8bde177d8c48 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.278377 May 24 13:56:16.462748 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 44/95] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:16 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:16.470276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:16.471739 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:16.488143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:16.488603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:16.489516 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:16.490014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:16.877330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:16.893954 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f4636839-5579-4bbd-8850-ffa9811dff01 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.426345 May 24 13:56:16.900645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 52/96] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:16 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:17.479146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:17.479765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:17.489041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:17.489816 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:17.490848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.491895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:17.494068 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.494882 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:17.503146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.504086 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:17.504676 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.506416 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:17.544298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:17.782751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:17.800582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-67b4cc7c-c609-4e54-a4e9-a309369e0178 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.326580 May 24 13:56:17.802733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 45/97] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:17 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:17.815912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:17.827109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-65532d24-1474-48e2-b18b-fbfdfa5560e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.343923 May 24 13:56:17.828866 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 53/98] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:17 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:17.851701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-116704fc-ddc3-443b-9c3c-f7c892879a19 req-5f01a4c6-7dbb-466f-a3d3-b6660fd16207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f67703-35a4-40ad-a442-d8230c57ca65", "name": "network-vif-plugged", "status": "completed", "tag": "962017d2-ce45-4701-b48a-e3e4aa4836f5"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:17.862790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-116704fc-ddc3-443b-9c3c-f7c892879a19 req-5f01a4c6-7dbb-466f-a3d3-b6660fd16207 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.863351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-116704fc-ddc3-443b-9c3c-f7c892879a19 req-5f01a4c6-7dbb-466f-a3d3-b6660fd16207 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:17.882427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-116704fc-ddc3-443b-9c3c-f7c892879a19 req-5f01a4c6-7dbb-466f-a3d3-b6660fd16207 service nova] Creating event network-vif-plugged:962017d2-ce45-4701-b48a-e3e4aa4836f5 for instance 84f67703-35a4-40ad-a442-d8230c57ca65 on hv-cinder-84212 May 24 13:56:17.890152 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-116704fc-ddc3-443b-9c3c-f7c892879a19 req-5f01a4c6-7dbb-466f-a3d3-b6660fd16207 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043061 May 24 13:56:17.891163 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 46/99] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:56:17.911770 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:17.912587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:17.922412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.923122 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:17.924180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:17.924635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:18.080090 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:18.089357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8d2b3637-9783-4fed-beb2-eb0b62e51f3b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.182404 May 24 13:56:18.090024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 54/100] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:17 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:18.820950 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:18.822379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:18.832535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:18.832717 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:18.838290 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:18.846749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:18.847514 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:18.855769 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:18.861855 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:18.861855 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:18.862462 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:18.862930 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:19.096145 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:19.109183 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0c129878-cb6d-4572-ad55-eb98ab66e120 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1315 microversion: 2.1 time: 0.292828 May 24 13:56:19.111626 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 47/101] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:18 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:19.137397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:19.137397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:19.144479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:19.144911 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:19.145684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:19.146116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:19.175296 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:19.178784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:19.189918 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c805b0af-4f58-462c-ae5c-3c93dbf1d0e2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.347740 May 24 13:56:19.190819 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 55/102] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:18 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:19.309048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:19.320146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-69ab774f-787c-4bf1-9b38-d7fdc15dfc13 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.205733 May 24 13:56:19.330781 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 48/103] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:19 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:20.129527 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:20.130711 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:20.140117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:20.142800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:20.143963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:20.148337 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:20.215397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:20.216793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:20.223802 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:20.224291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:20.225104 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:20.225709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:20.388558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:20.398068 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dec47150-0733-441a-9ecc-92fd48151d35 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.193839 May 24 13:56:20.400178 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 49/104] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:20 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:20.405717 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:20.406545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:20.413991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:20.415382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:20.416392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:20.417645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:20.441973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:20.452308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bdb47d2e-f905-4b21-99cd-14927cce6864 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1501 microversion: 2.1 time: 0.327268 May 24 13:56:20.453381 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 56/105] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:20 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1501 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:20.603180 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:20.612526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-49925693-47cc-4e57-9ba2-48c374526952 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.210719 May 24 13:56:20.613535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 50/106] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:20 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:21.416002 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:21.417300 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:21.426797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:21.427495 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:21.429118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:21.430852 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:21.632019 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:21.633362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:21.654617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:21.658644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:21.659770 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:21.663764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:21.776841 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:21.788069 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ad0b1b1c-bc0b-4182-a48b-768c4d69e5e6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.373690 May 24 13:56:21.788700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 57/107] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:21 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:21.993258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:22.002333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fcdaaf4-aaa3-4a3a-ac07-dd596a7fdb40"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:22.003377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cf03dc65-5778-40f7-bc51-b9acda91b690 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.376183 May 24 13:56:22.003490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:22.004622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 51/108] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:21 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:22.023542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:22.024497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:22.025467 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:22.025989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:22.808031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:22.809180 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:22.821603 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:22.824023 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:22.827599 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:22.828889 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:23.214157 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:23.222332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2992df14-7f06-4ab9-ad75-a55787a4d40b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.419513 May 24 13:56:23.223302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 52/109] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:22 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:23.240395 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:23.241729 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:23.249595 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:23.256825 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:23.257916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:23.259114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:23.407105 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:23.416970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-db53296a-e22a-4492-abe4-4a89059faccd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.183324 May 24 13:56:23.417999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 53/110] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:23 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:23.606433 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3a7a16f4-4fdc-4238-a44a-decfe4502aa6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "POST /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.610250 May 24 13:56:23.613345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 58/111] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 13:56:21 2022] POST /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d/os-volume_attachments => generated 194 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:56:24.241152 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:24.242076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:24.254742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:24.255469 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:24.256309 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:24.256755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:24.295719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-f51bcea8-f25f-487b-b1c6-f167313ecfb2 req-21012e3c-eaed-4a08-9dec-1cca6ca685d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9302a225-a5b2-456b-97ef-a6c329608645", "name": "network-vif-plugged", "status": "completed", "tag": "52d23d1f-444b-41aa-8726-0248ab97db05"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:24.361878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f51bcea8-f25f-487b-b1c6-f167313ecfb2 req-21012e3c-eaed-4a08-9dec-1cca6ca685d5 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:24.364809 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f51bcea8-f25f-487b-b1c6-f167313ecfb2 req-21012e3c-eaed-4a08-9dec-1cca6ca685d5 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:24.392885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-f51bcea8-f25f-487b-b1c6-f167313ecfb2 req-21012e3c-eaed-4a08-9dec-1cca6ca685d5 service nova] Creating event network-vif-plugged:52d23d1f-444b-41aa-8726-0248ab97db05 for instance 9302a225-a5b2-456b-97ef-a6c329608645 on hv-cinder-84212 May 24 13:56:24.411018 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-f51bcea8-f25f-487b-b1c6-f167313ecfb2 req-21012e3c-eaed-4a08-9dec-1cca6ca685d5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118669 May 24 13:56:24.412324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 59/112] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:24.459846 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:24.472628 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:24.509947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:24.514132 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:24.516324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:24.517201 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:24.579782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:24.591453 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6007a6a4-8a8c-4675-ae76-7c0ed2eb9c91 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1321 microversion: 2.1 time: 0.354925 May 24 13:56:24.605116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 54/113] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:24 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:24.791358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:24.800031 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-13158257-d1ca-42fd-8cb9-470403ac1d21 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.368949 May 24 13:56:24.800979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 60/114] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:24 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:25.610669 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:25.612087 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:25.625927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:25.628371 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:25.630141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:25.633092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:25.818643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:25.820041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:25.843416 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:25.846487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:25.847762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:25.851549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:25.996762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:26.006101 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a0fd1c81-1c39-42ef-9af2-6fa91d741778 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1516 microversion: 2.1 time: 0.399972 May 24 13:56:26.022080 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 55/115] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:25 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:26.034136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:26.035221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:26.050936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:26.051398 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:26.052207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:26.052647 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:26.147836 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:26.157254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-552b2a3e-b83f-44be-97e5-dabaaabc688e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.344103 May 24 13:56:26.163945 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 61/116] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:25 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:26.206867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lazy-loading 'flavor' on Instance uuid 84f67703-35a4-40ad-a442-d8230c57ca65 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:56:26.442803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-eed7b03c-aa9a-4ac6-903c-2c1f789217da req-f88715fa-ad0f-4264-959c-07017e575841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f19875e-64fa-4a59-9a45-a3d6e7ae96d6", "name": "network-vif-plugged", "status": "completed", "tag": "b953d341-a6ef-44a5-b545-6c5db2385fb4"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:26.478358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-eed7b03c-aa9a-4ac6-903c-2c1f789217da req-f88715fa-ad0f-4264-959c-07017e575841 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:26.482688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-eed7b03c-aa9a-4ac6-903c-2c1f789217da req-f88715fa-ad0f-4264-959c-07017e575841 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:26.529275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-eed7b03c-aa9a-4ac6-903c-2c1f789217da req-f88715fa-ad0f-4264-959c-07017e575841 service nova] Creating event network-vif-plugged:b953d341-a6ef-44a5-b545-6c5db2385fb4 for instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 on hv-cinder-84212 May 24 13:56:26.544346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-eed7b03c-aa9a-4ac6-903c-2c1f789217da req-f88715fa-ad0f-4264-959c-07017e575841 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106237 May 24 13:56:26.545775 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 62/117] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:26.669610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-307ba5cf-b4ca-4a7c-b865-10e65032d696 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65/action" status: 200 len: 32 microversion: 2.1 time: 0.645977 May 24 13:56:26.670896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 56/118] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 13:56:26 2022] POST /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65/action => generated 32 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:56:26.683569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:26.684484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:26.691369 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:26.692411 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:26.693352 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:26.694373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:26.904889 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:26.912668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7254a7ec-a24b-4951-b903-f84e6428d4e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.236061 May 24 13:56:26.913263 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 63/119] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:26 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:27.189564 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:27.190685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:27.198377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:27.198838 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:27.199892 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:27.200408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:27.355075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:27.363908 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5e8d6439-bf74-46d5-8ebc-a1f6b563695d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1365 microversion: 2.1 time: 0.179191 May 24 13:56:27.364574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 57/120] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:27 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:27.933754 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:27.934485 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:27.943576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:27.944127 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:27.945159 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:27.946363 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:28.119685 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:28.127893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-37393b61-416e-4c7e-a9d9-d522b1a802d1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.200837 May 24 13:56:28.129550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 64/121] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:27 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:28.381101 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:28.381707 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:28.388488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:28.388973 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:28.389749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:28.390354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:28.562606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:28.570109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fb0dabce-ed12-4abe-ae50-5db6817353f5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1556 microversion: 2.1 time: 0.193094 May 24 13:56:28.571225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 58/122] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:28 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:28.587879 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:28.588393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:28.594397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:28.594877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:28.595635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:28.596122 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:28.671997 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5c27f0e7-171d-4c29-8780-2fe92f42f226 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087924 May 24 13:56:28.672639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 65/123] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 13:56:28 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:29.146211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:29.146825 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:29.153374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:29.153831 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:29.154611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:29.155051 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:29.287152 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:29.295412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-33745674-6f07-4878-b93b-c8d70e77c121 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.152928 May 24 13:56:29.295979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 59/124] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:29 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:29.781393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-631e68d3-1597-4283-bfea-6ccf718d60b9 req-3aead725-9305-46bb-b7c9-21e849cb6c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9302a225-a5b2-456b-97ef-a6c329608645", "tag": "52d23d1f-444b-41aa-8726-0248ab97db05"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:29.789910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-631e68d3-1597-4283-bfea-6ccf718d60b9 req-3aead725-9305-46bb-b7c9-21e849cb6c5c service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:29.790349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-631e68d3-1597-4283-bfea-6ccf718d60b9 req-3aead725-9305-46bb-b7c9-21e849cb6c5c service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:29.801203 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-631e68d3-1597-4283-bfea-6ccf718d60b9 req-3aead725-9305-46bb-b7c9-21e849cb6c5c service nova] Creating event network-changed:52d23d1f-444b-41aa-8726-0248ab97db05 for instance 9302a225-a5b2-456b-97ef-a6c329608645 on hv-cinder-84212 May 24 13:56:29.807002 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-631e68d3-1597-4283-bfea-6ccf718d60b9 req-3aead725-9305-46bb-b7c9-21e849cb6c5c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029728 May 24 13:56:29.807591 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 66/125] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:56:30.313700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:30.314304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:30.320667 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:30.321376 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:30.322197 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:30.322633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:30.455342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:30.459348 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:30.464771 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e031de5d-9fe7-4a1f-8c25-af93062e2ead tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.154805 May 24 13:56:30.465542 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 60/126] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:30 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:31.483645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:31.484374 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:31.490583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:31.491041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:31.492392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:31.492774 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:31.624182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:31.631907 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-31874880-d896-4a0d-8389-9ad582634fd7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.153170 May 24 13:56:31.632599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 67/127] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:31 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:32.650745 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:32.651367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:32.658040 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:32.658593 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:32.659377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:32.659843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:32.796269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:32.803850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d225713a-91f4-455e-b34b-87e548dca1ce tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.158553 May 24 13:56:32.804400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 61/128] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:32 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:33.824286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:33.825664 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:33.834296 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=66 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:33.838678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:33.847176 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:33.848197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:33.848650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:33.989941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:34.003033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-62c09366-a461-420f-8ca0-f71a3b29ee7f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.183878 May 24 13:56:34.003888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 68/129] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:33 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:35.020989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:35.021531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:35.023789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=70 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:35.029037 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:35.029475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:35.030231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:35.030659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:35.160327 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:35.168396 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bb9aae70-00b2-4b59-9430-2566ace3830f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.151381 May 24 13:56:35.168963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 62/130] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:35 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:36.184915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:36.185521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:36.191981 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:36.192430 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:36.193177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:36.193606 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:36.464591 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:36.472054 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6aeb2a53-3b38-48b8-9b21-7bf2b27f0cea tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.290881 May 24 13:56:36.472621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 69/131] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:36 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:37.489079 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:37.489684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:37.496160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:37.496605 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:37.497359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:37.497794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:37.627241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:37.634926 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f3e73f25-b933-47f3-bf8e-d6588c4081f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.149746 May 24 13:56:37.635491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 63/132] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:37 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:38.652299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:38.652955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:38.659332 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:38.659781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:38.660672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:38.661115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:38.806187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:38.813643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c6ee16e8-37ca-4c40-93af-3c23ad0fe713 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.165644 May 24 13:56:38.814218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 70/133] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:38 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:39.833050 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:39.833665 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:39.840305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:39.840754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:39.841549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:39.842006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:40.028274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:40.037765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dbe1d16d-f798-4768-82da-b275cb6e898e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.208524 May 24 13:56:40.049148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 64/134] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:39 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:41.057349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:41.057958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:41.064458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:41.064904 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:41.065670 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:41.066106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:41.194205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:41.201923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-011c059a-e1d8-476e-9514-40cadbcc5d3e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.148443 May 24 13:56:41.202729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 71/135] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:41 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:42.219291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:42.219974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:42.226221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:42.226689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:42.227447 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:42.227903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:42.354140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:42.361487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-86a26416-aa14-45e6-9731-ba03f361f74c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.146087 May 24 13:56:42.362054 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 65/136] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:42 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:43.377924 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:43.378708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:43.385339 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:43.385794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:43.386566 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:43.387007 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:43.519636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:43.527767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b3888a2b-dfff-4e2f-a7ee-9fcba81a6939 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.153734 May 24 13:56:43.528385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 72/137] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:43 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:44.545005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:44.545611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:44.551666 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:44.552146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:44.552894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:44.553323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:44.679574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:44.687137 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6bc82095-14c8-404d-90a4-8194d34d6c2b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.145967 May 24 13:56:44.687696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 66/138] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:44 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:45.704298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:45.704933 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:45.711995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:45.712438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:45.713267 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:45.713698 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:45.732827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:45.965701 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:45.974114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-11d1ad77-189b-4e46-bb84-6415c30b671d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.273528 May 24 13:56:45.974716 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 73/139] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:45 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:46.438083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:46.438583 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:46.445318 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:46.445767 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:46.446717 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:46.447162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:46.472276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:56:46.558542 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9c5b4e01-e033-4748-85e7-1310f6e0da11 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 204 len: 0 microversion: 2.1 time: 0.124113 May 24 13:56:46.559131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 67/140] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 13:56:46 2022] DELETE /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 13:56:46.570179 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:46.571386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:46.578928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:46.579380 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:46.580185 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:46.580627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:46.714513 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:46.722894 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dab1e34b-c0f5-4ee2-b102-f2838664c736 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1553 microversion: 2.1 time: 0.159548 May 24 13:56:46.723636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 74/141] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:46 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:46.993316 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:46.994131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:47.001465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:47.001988 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:47.002961 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:47.003731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:47.144424 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:47.152511 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-67fd2c34-8758-4f4b-9b80-2b7e8d3a5cb0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.164534 May 24 13:56:47.153078 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 68/142] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:46 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:47.741635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:47.742488 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:47.762292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:47.762734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:47.763669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:47.764662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:47.966250 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:47.975941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e89efd39-95fe-40aa-862f-0cb918428bec tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1553 microversion: 2.1 time: 0.238112 May 24 13:56:47.976643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 75/143] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:47 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:48.171607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:48.172416 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:48.180333 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:48.181161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:48.182110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:48.182788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:48.357934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:48.370255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6e721871-534e-482e-b0e4-582fd59424fe tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.202803 May 24 13:56:48.371699 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 69/144] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:48 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:48.994435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:48.995350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:49.014557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:49.015480 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:49.016691 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:49.017357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:49.242353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:49.259460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a735ff3a-f983-4211-90a8-40555d4ac9ab tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1553 microversion: 2.1 time: 0.270485 May 24 13:56:49.270416 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 76/145] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:48 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:49.389392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:49.390681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:49.405863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:49.407785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:49.410121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:49.410575 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:49.874770 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:49.884416 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a6285a73-3378-41b1-9317-91c69a4c32f9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.499470 May 24 13:56:49.885207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 70/146] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:49 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:50.278187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:50.278810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:50.289769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:50.290779 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:50.291847 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:50.293547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:50.502606 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:50.520345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3cf065ea-0907-4709-82db-9e4f218e93eb tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1553 microversion: 2.1 time: 0.247603 May 24 13:56:50.530371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 77/147] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:50 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:50.624457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-0f143da1-3f43-4fe9-8f5b-221ba69959da req-dabc171d-9cad-4b13-8467-68d315e33eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dd759e-f58f-4459-b7da-0cb782f87e6d", "name": "network-vif-deleted", "tag": "56936aaa-5166-4c7c-8b7c-5354a85bc313"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:56:50.660530 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0f143da1-3f43-4fe9-8f5b-221ba69959da req-dabc171d-9cad-4b13-8467-68d315e33eeb service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:50.661024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0f143da1-3f43-4fe9-8f5b-221ba69959da req-dabc171d-9cad-4b13-8467-68d315e33eeb service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:50.689956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-0f143da1-3f43-4fe9-8f5b-221ba69959da req-dabc171d-9cad-4b13-8467-68d315e33eeb service nova] Creating event network-vif-deleted:56936aaa-5166-4c7c-8b7c-5354a85bc313 for instance 62dd759e-f58f-4459-b7da-0cb782f87e6d on hv-cinder-84212 May 24 13:56:50.707193 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-0f143da1-3f43-4fe9-8f5b-221ba69959da req-dabc171d-9cad-4b13-8467-68d315e33eeb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089554 May 24 13:56:50.708358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 71/148] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:56:50.908757 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:50.909427 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:50.919592 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:50.920600 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:50.922125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:50.922563 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:51.142496 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:51.153631 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fe56980a-616e-4710-93ee-52355c55cc7c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.255000 May 24 13:56:51.156539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 78/149] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:50 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:51.540017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:51.540017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:51.546699 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:51.547221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:51.548280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:51.548719 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:51.590419 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:51.591191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:51.591862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lazy-loading 'fault' on Instance uuid 62dd759e-f58f-4459-b7da-0cb782f87e6d {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:56:51.654275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae3b6e3b2e24719ad90614dc5c7e431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '469bcf4beb3041559397e70538a7ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:51.662386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7579e9e4-1363-4442-8ecb-e29d1cacdde6 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 200 len: 1351 microversion: 2.1 time: 0.128817 May 24 13:56:51.663326 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 72/150] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:51 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:52.173405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:52.174583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:52.185934 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:52.189364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:52.190516 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:52.193570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:52.365048 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:52.374917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dd086a7e-a31a-4d65-9c3c-df6a295cb1e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.205143 May 24 13:56:52.375915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 79/151] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:52 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:56:52.682700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:52.685157 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:52.696266 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:52.697129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:52.698365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:52.699026 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:52.719473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] HTTP exception thrown: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Request method failure captured: May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d HTTP/1.1 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPUoVYa0RS21MVqXgyoqV4OLobv8Ztox6E3RMj2BYEaIkdg17oW4oXvoqIRywzO3J9KCnMGTdQw-1HvaC9A8hXLj2G86SLpf1NtY6EPBrVt2GAyD9EEjPADzb352-l428KLMZnzUUooBHaxxNDD_3KfzT1rK05LbQXnRVkeN9RZgG8 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:56:52.732414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_469bcf4beb3041559397e70538a7ea12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-DeleteServersTestJSON-841853089 May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: fae3b6e3b2e24719ad90614dc5c7e431 May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.733762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '62dd759e-f58f-4459-b7da-0cb782f87e6d'} May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:56:52.734547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.736349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:52.738103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Returning 404 to user: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:56:52.738103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8a9b563f-7238-4ccd-a457-f24b4e150417 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 404 len: 111 microversion: 2.1 time: 0.056204 May 24 13:56:52.738103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 73/152] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:52 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:56:52.862278 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:52.863266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:52.869566 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:52.870018 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:52.870844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:52.871279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:52.886122 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] HTTP exception thrown: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Request method failure captured: May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d/os-volume_attachments HTTP/1.1 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPUoVYa0RS21MVqXgyoqV4OLobv8Ztox6E3RMj2BYEaIkdg17oW4oXvoqIRywzO3J9KCnMGTdQw-1HvaC9A8hXLj2G86SLpf1NtY6EPBrVt2GAyD9EEjPADzb352-l428KLMZnzUUooBHaxxNDD_3KfzT1rK05LbQXnRVkeN9RZgG8 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:56:52.890963 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_469bcf4beb3041559397e70538a7ea12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-DeleteServersTestJSON-841853089 May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: fae3b6e3b2e24719ad90614dc5c7e431 May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.892163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': '62dd759e-f58f-4459-b7da-0cb782f87e6d'} May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:56:52.893291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:52.894357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:52.895503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Returning 404 to user: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:56:52.895503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3a63743e-b712-4cbd-9c31-ed393d353fb7 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034220 May 24 13:56:52.895503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 80/153] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 13:56:52 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:56:53.393710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:53.394698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:53.402722 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:53.403291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:53.404334 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:53.404805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:53.554070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:53.571991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ad7ac1cc-9593-49e5-8bb1-c74c6653ce9c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.174131 May 24 13:56:53.571991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 74/154] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:53 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:54.584234 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:54.585540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:54.592491 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:54.593008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:54.593841 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:54.594345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:54.741729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:54.750382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-06602358-ef9d-481e-b8f9-7f01c3718823 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.172953 May 24 13:56:54.750958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 81/155] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:54 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:55.196130 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:55.196655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:55.202736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:55.203186 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:55.203979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:55.204417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:55.217898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] HTTP exception thrown: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Request method failure captured: May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d HTTP/1.1 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPUoVYa0RS21MVqXgyoqV4OLobv8Ztox6E3RMj2BYEaIkdg17oW4oXvoqIRywzO3J9KCnMGTdQw-1HvaC9A8hXLj2G86SLpf1NtY6EPBrVt2GAyD9EEjPADzb352-l428KLMZnzUUooBHaxxNDD_3KfzT1rK05LbQXnRVkeN9RZgG8 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:56:55.219408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_469bcf4beb3041559397e70538a7ea12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-DeleteServersTestJSON-841853089 May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: fae3b6e3b2e24719ad90614dc5c7e431 May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.220780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '62dd759e-f58f-4459-b7da-0cb782f87e6d'} May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:56:55.221518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.222869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:56:55.224508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Returning 404 to user: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:56:55.224508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1fd23ccc-06ed-4aca-bc65-3f7f89fb00ae tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 404 len: 111 microversion: 2.1 time: 0.029227 May 24 13:56:55.224508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 75/156] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 13:56:55 2022] DELETE /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:56:55.229346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:55.229960 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] [instance: 62dd759e-f58f-4459-b7da-0cb782f87e6d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:55.235843 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:55.236299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:55.237054 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:55.237488 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:55.250628 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] HTTP exception thrown: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Request method failure captured: May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d HTTP/1.1 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPUoVYa0RS21MVqXgyoqV4OLobv8Ztox6E3RMj2BYEaIkdg17oW4oXvoqIRywzO3J9KCnMGTdQw-1HvaC9A8hXLj2G86SLpf1NtY6EPBrVt2GAyD9EEjPADzb352-l428KLMZnzUUooBHaxxNDD_3KfzT1rK05LbQXnRVkeN9RZgG8 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:56:55.252764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_469bcf4beb3041559397e70538a7ea12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/469bcf4beb3041559397e70538a7ea12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-DeleteServersTestJSON-841853089 May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 469bcf4beb3041559397e70538a7ea12 May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-DeleteServersTestJSON-841853089 May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: fae3b6e3b2e24719ad90614dc5c7e431 May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-DeleteServersTestJSON-841853089-project May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.254405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '62dd759e-f58f-4459-b7da-0cb782f87e6d'} May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:56:55.255395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. May 24 13:56:55.257429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:56:55.259043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] Returning 404 to user: Instance 62dd759e-f58f-4459-b7da-0cb782f87e6d could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:56:55.259043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8c3ab4d5-766f-4e64-92f4-b4c2c51b68e3 tempest-DeleteServersTestJSON-841853089 tempest-DeleteServersTestJSON-841853089-project] 10.222.0.24 "GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d" status: 404 len: 111 microversion: 2.1 time: 0.029198 May 24 13:56:55.259043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 82/157] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:55 2022] GET /compute/v2.1/servers/62dd759e-f58f-4459-b7da-0cb782f87e6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:56:55.768753 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:55.769645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:55.779845 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:55.780592 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:55.781831 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:55.782697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:55.941135 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:55.951216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2e510a04-5577-406f-b50c-8a555c5894e5 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.187382 May 24 13:56:55.961184 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 76/158] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:55 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:56.968175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:56.968814 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:56.976109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:56.976566 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:56.977337 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:56.977777 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:57.151798 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:57.160285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3aa6cab1-222b-49e2-81b0-6a7cdb471391 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.196319 May 24 13:56:57.160853 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 83/159] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:56 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:58.178850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:58.179461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:58.186330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:58.186779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:58.187731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:58.188196 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:58.205147 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:56:58.418195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:58.426076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0cebb300-c489-4e99-8a12-e1cb9fd7071a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.251448 May 24 13:56:58.426655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 77/160] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:58 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:56:59.449608 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:56:59.454305 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:56:59.461636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:59.462317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:59.463094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:56:59.463529 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:56:59.659095 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:56:59.671500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e740aca9-4b47-4206-9b05-15aa866f1e61 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.229980 May 24 13:56:59.672904 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 84/161] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:56:59 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:00.689317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:00.689927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:00.697329 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:00.697770 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:00.699761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:00.700111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:00.972465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:00.980772 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a45e1324-1b3b-44ec-b7ab-8977a454fc27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.295389 May 24 13:57:00.981683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 78/162] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:00 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:01.960056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0b7b2873-ee90-4f03-8d0f-ca7d409bd1ad tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'create', calling method: .version_select at 0x7f33b75c4820>, body: {"keypair": {"name": "tempest-keypair-123001339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdXV1a+l2e9josEko0EVFuIqcK2RozAL4+EDOdqeW4dkGqNJ8H8xdjRcFZKgG10EKUEUkF2NVYNJ88LWARMmPBZ3AD6Dv2Uz4Ny7giU+DTUnoMesV12hYOWNDarDUXlUw=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:01.980077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-0b7b2873-ee90-4f03-8d0f-ca7d409bd1ad tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:01.983936 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-0b7b2873-ee90-4f03-8d0f-ca7d409bd1ad tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for user b3560616f4ec496f816602f9c73b69ef and project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:01.999304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:02.000124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:02.007288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:02.007736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:02.008797 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:02.009335 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:02.026450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0b7b2873-ee90-4f03-8d0f-ca7d409bd1ad tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.188409 May 24 13:57:02.027856 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 85/163] 10.222.0.24 () {62 vars in 1199 bytes} [Tue May 24 13:57:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 190 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 13:57:02.202617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:02.216399 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f2798a66-c400-4f98-a39b-ca680aa78979 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.221200 May 24 13:57:02.226901 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 79/164] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:01 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:03.234345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:03.235615 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:03.269802 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:03.270458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:03.275506 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:03.276359 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:03.534590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-135991990", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18065f5d-f31e-4fd3-b029-c409167bb83c"}], "security_groups": [{"name": "tempest-securitygroup--563120442"}], "key_name": "tempest-keypair-123001339", "user_data": "}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:03.535075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:03.571868 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f514c5bd-1a91-4664-ae96-15ddec6a1a97 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.341086 May 24 13:57:03.580586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 86/165] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:03 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:03.751801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] validate_networks() for [('18065f5d-f31e-4fd3-b029-c409167bb83c', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:57:04.244231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:57:04.244678 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:57:04.245173 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:57:04.245602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:57:04.246013 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:57:04.255320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:04.256308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:04.257109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:04.257541 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:04.277014 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:04.283592 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for user b3560616f4ec496f816602f9c73b69ef and project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:04.304070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:57:04.306380 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:57:04.367243 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-460eee7f-62e1-495d-b249-04f4b363ac68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.873582 May 24 13:57:04.368282 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 80/166] 10.222.0.24 () {62 vars in 1187 bytes} [Tue May 24 13:57:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 13:57:04.378498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-60ff74cd-0cf0-4495-8272-0d9b5f9369b2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:04.379283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-60ff74cd-0cf0-4495-8272-0d9b5f9369b2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:04.388478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:04.446149 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60ff74cd-0cf0-4495-8272-0d9b5f9369b2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:04.456712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60ff74cd-0cf0-4495-8272-0d9b5f9369b2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:04.458469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60ff74cd-0cf0-4495-8272-0d9b5f9369b2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:04.460975 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-60ff74cd-0cf0-4495-8272-0d9b5f9369b2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1280 microversion: 2.20 time: 0.087136 May 24 13:57:04.467950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 87/167] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:04 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:04.607279 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:04.608764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:04.620045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:04.620843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:04.621652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:04.622097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:04.807213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:04.816844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ee9ea42f-1aed-4a47-a122-e52b0d1ea5d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.218554 May 24 13:57:04.817523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 81/168] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:04 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:05.479172 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:05.479809 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:05.487336 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:05.487708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:05.488505 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:05.488943 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:05.555230 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:05.563475 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:05.565049 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:05.566195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-af5b5975-3781-47d2-ad0b-b9162e087e7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1284 microversion: 2.20 time: 0.090929 May 24 13:57:05.566762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 88/169] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:05 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:05.836530 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:05.837140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:05.840020 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:05.845094 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:05.845619 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:05.846391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:05.846826 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:05.977734 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:05.985507 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-08c7c6d7-fbcf-424b-87c7-4ee9cf807c8d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.154266 May 24 13:57:05.986080 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 82/170] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:05 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:06.584642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:06.585294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:06.592020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:06.592474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:06.593235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:06.593671 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:06.653086 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:06.660846 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:06.663072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:06.664196 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-58e74155-7672-4eaa-8b8b-5a792a83617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1284 microversion: 2.20 time: 0.084081 May 24 13:57:06.664782 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 89/171] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:06 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:07.002198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:07.003049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:07.009097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:07.009536 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:07.010292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:07.010716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:07.142882 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:07.150523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b81355d2-8727-42b9-87c4-391b0af2d80d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.152097 May 24 13:57:07.151090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 83/172] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:06 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:07.681907 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:07.682505 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:07.689087 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:07.689535 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:07.690288 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:07.690723 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:07.759773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:07.769730 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:07.772884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:07.774029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b8a59a2-3157-4ca3-a8d5-156802ac1ff3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1332 microversion: 2.20 time: 0.096020 May 24 13:57:07.774781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 90/173] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:07 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:08.166545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:08.167148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:08.173167 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:08.173617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:08.174387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:08.174819 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:08.593366 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:08.601379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-db9bfcaa-3be9-474f-b3e8-e2a76637ba8b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.438700 May 24 13:57:08.601953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 84/174] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:08 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:08.796433 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:08.797548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:08.808406 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:08.808936 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:08.809774 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:08.810286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:08.872657 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:08.881011 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:08.882577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:08.883713 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-43ccccba-bf50-44a8-ba4a-70a191ece1ee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1338 microversion: 2.20 time: 0.092554 May 24 13:57:08.884462 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 91/175] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:08 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1338 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:09.619246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:09.619953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:09.630280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:09.630923 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:09.631760 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:09.632295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:09.904337 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:09.905627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:09.909623 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:09.915715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:09.916837 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:09.918034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:09.918536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:09.921659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a0f88df8-a024-4391-b629-9600b6bc024b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.306667 May 24 13:57:09.922304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 85/176] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:09 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:10.095108 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-8abe3bf7-1de1-404c-8739-350dd1b49bed req-ec19d8fa-8ffc-41df-a070-16c1a10c32d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:10.123730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-8abe3bf7-1de1-404c-8739-350dd1b49bed req-ec19d8fa-8ffc-41df-a070-16c1a10c32d4 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:10.128660 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-8abe3bf7-1de1-404c-8739-350dd1b49bed req-ec19d8fa-8ffc-41df-a070-16c1a10c32d4 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:10.150740 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-8abe3bf7-1de1-404c-8739-350dd1b49bed req-ec19d8fa-8ffc-41df-a070-16c1a10c32d4 service nova] Creating event network-changed:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 13:57:10.151168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:10.158782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-8abe3bf7-1de1-404c-8739-350dd1b49bed req-ec19d8fa-8ffc-41df-a070-16c1a10c32d4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070774 May 24 13:57:10.159669 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 86/177] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:10.161043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:10.163229 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:10.164467 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-77ea3a93-9ae6-4bcf-89fc-4af12e6ac258 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.265207 May 24 13:57:10.165318 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 92/178] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:09 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:10.945342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:10.946057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:10.953083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:10.953553 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:10.954347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:10.955504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:11.098487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:11.111228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ac425270-7f67-4777-838d-707e1cb27d69 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.174737 May 24 13:57:11.121245 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 87/179] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:10 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:11.182269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:11.183332 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:11.189711 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:11.190160 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:11.190911 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:11.191343 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:11.209907 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:11.362861 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:11.372420 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:11.374231 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:11.375342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f5acc6a1-a348-4ae1-a5ff-c311361dcd96 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.196971 May 24 13:57:11.376212 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 93/180] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:11 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:12.129526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:12.130289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:12.138328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:12.139233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:12.140216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:12.140826 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:12.290806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:12.298480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0f6104ee-3514-4556-9164-870e59742459 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.173646 May 24 13:57:12.299270 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 88/181] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:12 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:12.396515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:12.397905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:12.406669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:12.407405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:12.408550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:12.409446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:12.576651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:12.587717 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:12.589644 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:12.591392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-37e5f1bf-6ed9-4aa1-b695-aaf0c4296e09 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.199800 May 24 13:57:12.591998 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 94/182] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:12 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:13.322969 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:13.325019 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:13.334911 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:13.335737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:13.336780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:13.337399 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:13.506894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:13.517263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fc599816-01b7-4b54-9e35-edf6cb8fcdcd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.201432 May 24 13:57:13.518568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 89/183] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:13 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:13.611782 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:13.613215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:13.633358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:13.633872 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:13.634704 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:13.635152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:13.930456 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:13.943379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:13.950461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:13.951627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a9820b5-4406-40d3-8fa1-edacc06e54ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.344255 May 24 13:57:13.954894 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 95/184] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:13 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:14.537459 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:14.538480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:14.554250 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:14.559767 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:14.562392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:14.563129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:14.566090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:14.566833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:14.871884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:14.883239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-58c79473-d4a3-4707-b8e9-4add377ee138 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.352051 May 24 13:57:14.886884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 90/185] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:14 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:14.970559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:14.971164 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:14.979614 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:14.982445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:14.983121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:14.984203 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:14.984833 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:15.404700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:15.414156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:15.415844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:15.417382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0967aacd-0936-4cf1-bcae-3a00f499bd26 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.450661 May 24 13:57:15.418170 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 96/186] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:14 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:15.908009 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:15.908646 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:15.917080 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:15.917737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:15.918903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:15.919438 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:16.250414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:16.262055 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8344b7c0-2bf1-42cc-9085-81327f4cfd1f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.361584 May 24 13:57:16.262820 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 91/187] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:15 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:16.439006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:16.440235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:16.452716 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:16.453221 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:16.454004 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:16.454441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:16.702884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:16.716597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:16.718884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:16.726267 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ffc57767-5b89-4ce0-9f27-fa152680c1e3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.289658 May 24 13:57:16.728129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 97/188] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:16 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:16.834736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-caecb905-1d35-4cd8-9bdd-d64fe849496e req-6b8b1049-edd4-40a7-97c2-0a15da6bac7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "name": "network-vif-plugged", "status": "completed", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:16.853976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-caecb905-1d35-4cd8-9bdd-d64fe849496e req-6b8b1049-edd4-40a7-97c2-0a15da6bac7f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:16.854602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-caecb905-1d35-4cd8-9bdd-d64fe849496e req-6b8b1049-edd4-40a7-97c2-0a15da6bac7f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:16.886489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-caecb905-1d35-4cd8-9bdd-d64fe849496e req-6b8b1049-edd4-40a7-97c2-0a15da6bac7f service nova] Creating event network-vif-plugged:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 13:57:16.899005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-caecb905-1d35-4cd8-9bdd-d64fe849496e req-6b8b1049-edd4-40a7-97c2-0a15da6bac7f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070673 May 24 13:57:16.899917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 92/189] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:17.282363 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:17.283525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:17.295441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:17.298292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:17.299602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:17.303146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:17.516013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:17.530638 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7a33a84b-797f-4921-be36-64240101bc2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.253595 May 24 13:57:17.532304 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 98/190] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:17 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:17.748140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:17.748921 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:17.757637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:17.758275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:17.759222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:17.759874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:17.913201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:17.922003 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:17.923626 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:17.925142 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bc5a3460-d193-4be7-b8ad-9d0c76905be0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.181876 May 24 13:57:17.925708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 93/191] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:17 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:18.549499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:18.550101 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:18.557738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:18.558478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:18.559470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:18.560153 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:18.713659 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:18.721703 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ba12bc98-d744-44ad-b0bd-fd960d008890 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1522 microversion: 2.1 time: 0.175897 May 24 13:57:18.722426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 99/192] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:18 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:18.952319 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:18.952949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:18.959473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:18.960308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:18.961088 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:18.961531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:19.103910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:19.113557 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:19.115955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:19.117232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-95d32fc2-68af-422b-a160-74dcec96f45f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1405 microversion: 2.20 time: 0.176763 May 24 13:57:19.118327 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 94/193] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:18 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:19.738169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:19.738777 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:19.746225 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:19.746884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:19.747898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:19.748413 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:19.925338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:19.940436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fb32b2b5-d300-4dc9-a3ae-c560246cdf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1502 microversion: 2.1 time: 0.205969 May 24 13:57:19.941191 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 100/194] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:19 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:19.958773 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:19.959440 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:19.966584 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:19.968476 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:19.971249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:19.971718 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:20.139424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:20.140099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:20.149371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:20.150227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:20.151180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:20.152278 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:20.182816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:20.203725 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dcb8585b-90d2-4782-b376-dbcc3790ce96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1515 microversion: 2.1 time: 0.250392 May 24 13:57:20.204365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 95/195] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:19 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:20.341651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:20.346886 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:20.350213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:20.351559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dbeb940d-cda3-4457-b184-34ad1f73b7a8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1596 microversion: 2.20 time: 0.217930 May 24 13:57:20.364625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 101/196] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 13:57:20 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1596 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 13:57:20.369404 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:20.369914 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:20.376580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:20.377035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:20.378164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:20.378650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:20.383650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:20.467597 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7ff15f6a-6951-481b-8aa4-b27a497ac2e4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101839 May 24 13:57:20.468224 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 96/197] 10.222.0.24 () {60 vars in 1315 bytes} [Tue May 24 13:57:20 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 13:57:21.563235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-d9cba61a-d6cc-428c-8484-e52ec1c7a7a5 req-e37d7029-e5fb-4032-b39f-8e954f0ca8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:21.572810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d9cba61a-d6cc-428c-8484-e52ec1c7a7a5 req-e37d7029-e5fb-4032-b39f-8e954f0ca8cc service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:21.573329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d9cba61a-d6cc-428c-8484-e52ec1c7a7a5 req-e37d7029-e5fb-4032-b39f-8e954f0ca8cc service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:21.585167 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-d9cba61a-d6cc-428c-8484-e52ec1c7a7a5 req-e37d7029-e5fb-4032-b39f-8e954f0ca8cc service nova] Creating event network-changed:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 13:57:21.590227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-d9cba61a-d6cc-428c-8484-e52ec1c7a7a5 req-e37d7029-e5fb-4032-b39f-8e954f0ca8cc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030729 May 24 13:57:21.590907 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 102/198] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:22.837431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:22.837956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:22.844227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:22.844541 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:22.845309 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:22.845743 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:22.868898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lazy-loading 'flavor' on Instance uuid 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:57:22.940595 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2c499e4d-2d06-4c43-a8f9-7586d1815889 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/action" status: 200 len: 32 microversion: 2.1 time: 0.108746 May 24 13:57:22.941206 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 97/199] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 13:57:22 2022] POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/action => generated 32 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 13:57:22.951801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:22.952521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:22.959592 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:22.960141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:22.960931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:22.961354 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:23.171180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:23.178734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d7d0d8a3-19ab-4204-9847-a15a2be0e77d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.231618 May 24 13:57:23.179315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 103/200] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:22 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:24.199793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:24.200650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:24.215274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:24.216793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:24.217774 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:24.218288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:24.359634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:24.367680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0f424fae-dcca-406e-83f1-352cd5e806b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.174764 May 24 13:57:24.368382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 98/201] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:24 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:25.385529 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:25.386148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:25.392976 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:25.393422 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:25.394232 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:25.394736 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:25.524760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:25.532082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bbc576a6-e6cb-4760-9d85-07beed7fed43 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.150442 May 24 13:57:25.532646 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 104/202] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:25 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:26.548243 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:26.548845 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:26.555157 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:26.555636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:26.556433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:26.556864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:26.686565 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:26.694823 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ca8efdd2-2c1e-4c99-94a8-0cd812f8d9e1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.150444 May 24 13:57:26.695397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 99/203] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:26 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:27.712585 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:27.713148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:27.719893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:27.720348 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:27.721115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:27.721588 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:27.853258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:27.860697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-33257bb5-2a45-4738-8aa2-5c68cab23258 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.152075 May 24 13:57:27.861269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 105/204] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:27 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:28.877864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:28.878470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:28.884753 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:28.885200 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:28.885953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:28.886386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:29.012500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:29.019902 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8b504da4-a0cb-4057-969b-2c6cd3e99bfc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.146107 May 24 13:57:29.020466 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 100/205] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:28 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:30.037576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:30.038212 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:30.044683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:30.045123 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:30.045872 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:30.046298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:30.173296 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:30.181077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-85aaf3c9-e1fc-4be2-acdc-1724db90dbf4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.147981 May 24 13:57:30.181977 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 106/206] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:30 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:31.197533 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:31.198106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:31.204403 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:31.204880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:31.205642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:31.206073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:31.339186 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:31.346667 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e7d45b29-13b3-47a1-bb56-e5438e0f41d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.153064 May 24 13:57:31.347226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 101/207] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:31 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:31.711773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1940985042", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:31.762872 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] validate_networks() for None {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:57:32.263838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:57:32.264269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:57:32.264880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:57:32.265136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:57:32.265547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:57:32.276092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:32.276541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:32.277337 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:32.277768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:32.294311 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Getting quotas for project 456ea6bbe702420cb7fa4284088efda2. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:32.298537 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Getting quotas for user 60bbd2f0609b4b8d81c9db106408eba8 and project 456ea6bbe702420cb7fa4284088efda2. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:32.311711 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:57:32.314017 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:57:32.361775 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a12d5cbf-e1ed-4302-bce2-28d466fc8336 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654780 May 24 13:57:32.365593 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:32.367168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:32.369053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 107/208] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:57:32.374759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a4b094e-9f6a-48a2-81c6-77a7980f4b0d tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:32.375374 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3a4b094e-9f6a-48a2-81c6-77a7980f4b0d tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:32.376344 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:32.377442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:32.378463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:32.378988 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:32.439865 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3a4b094e-9f6a-48a2-81c6-77a7980f4b0d tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:32.448589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3a4b094e-9f6a-48a2-81c6-77a7980f4b0d tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1215 microversion: 2.1 time: 0.077574 May 24 13:57:32.449741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 108/209] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:32 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:32.566259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:32.576458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1dcac6e7-ee34-444f-bd44-efec5068b43c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.215850 May 24 13:57:32.577118 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 102/210] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:32 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:33.465517 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:33.466122 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:33.472628 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:33.473071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:33.474538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:33.475219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:33.541842 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:33.549751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3c185531-5e32-48e8-85ef-80b1be5148ae tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1267 microversion: 2.1 time: 0.087807 May 24 13:57:33.550358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 109/211] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:33 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:33.595612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:33.596561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:33.604459 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:33.605164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:33.606130 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:33.606751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:33.762994 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:33.771124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cdb6a2c9-0dfe-4a89-a26d-4c3a9ff9b163 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.180544 May 24 13:57:33.771995 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 103/212] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:33 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:34.569209 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:34.570267 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:34.585285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:34.588347 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:34.588889 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:34.589752 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:34.590282 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:34.690685 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:34.702570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61977170-fd87-4339-8ce3-e7a2d7e755dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1273 microversion: 2.1 time: 0.137785 May 24 13:57:34.703701 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 110/213] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:34 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:34.790227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:34.790899 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:34.796915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:34.797578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:34.798562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:34.799145 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:35.031189 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:35.047899 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2e0fc662-b028-4b79-a744-a03e408e19a1 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.262357 May 24 13:57:35.048841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 104/214] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:34 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:35.720412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:35.723588 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:35.740074 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:35.740847 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:35.741962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:35.742546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:35.967615 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:35.977523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8774b3a6-3012-4655-8e24-51df7db65efe tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.260967 May 24 13:57:35.978484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 111/215] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:35 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:36.066230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:36.067481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:36.070540 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=46 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:36.074373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:36.075083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:36.075891 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:36.076319 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:36.221255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:36.229488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-491ea7a2-fbf0-478e-9416-21e30125bfef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.167507 May 24 13:57:36.230266 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 105/216] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:36 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:37.004416 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:37.006072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:37.014102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:37.021338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:37.022328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:37.023015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:37.048251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:37.248190 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:37.248934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:37.275120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:37.275665 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:37.276632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:37.277245 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:37.348972 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:37.386516 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c52d1feb-58d8-4704-9c0e-95d74dc4f829 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.387499 May 24 13:57:37.387644 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 112/217] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:36 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:37.484905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:37.522922 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3184b555-0dfb-425b-9839-66f9c13ff999 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.279617 May 24 13:57:37.523527 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 106/218] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:37 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:37.870100 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-026d1af2-2642-4817-97bc-1821c7889be3 req-3c27512d-9b60-4c20-8aac-0dc47301591f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86c9f2c-6076-42d9-95e1-c4781db7982b", "tag": "5efa9fbc-615b-4396-bd55-339ba5728851"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:37.891475 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-026d1af2-2642-4817-97bc-1821c7889be3 req-3c27512d-9b60-4c20-8aac-0dc47301591f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:37.892552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-026d1af2-2642-4817-97bc-1821c7889be3 req-3c27512d-9b60-4c20-8aac-0dc47301591f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:37.928405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-026d1af2-2642-4817-97bc-1821c7889be3 req-3c27512d-9b60-4c20-8aac-0dc47301591f service nova] Creating event network-changed:5efa9fbc-615b-4396-bd55-339ba5728851 for instance d86c9f2c-6076-42d9-95e1-c4781db7982b on hv-cinder-84212 May 24 13:57:37.940161 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-026d1af2-2642-4817-97bc-1821c7889be3 req-3c27512d-9b60-4c20-8aac-0dc47301591f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087398 May 24 13:57:37.941605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 113/219] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:38.405969 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:38.406642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:38.413790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:38.414606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:38.415387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:38.415809 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:38.549053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:38.552188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:38.567207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:38.567668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:38.568486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:38.568992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:38.617797 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:38.626918 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b161b1a2-bc26-4050-b047-ef6087152150 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.225163 May 24 13:57:38.628901 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 107/220] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:38 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:38.754857 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:38.763373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3522799e-ab73-4aa3-beee-5031d897b126 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.227673 May 24 13:57:38.767690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 114/221] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:38 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:39.650521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:39.651130 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:39.663253 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:39.664041 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:39.664816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:39.665314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:39.784538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:39.785218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:39.792831 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:39.793429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:39.794401 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:39.794902 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:39.892215 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:39.902649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1214c807-382f-4158-9d16-b9d5375ca45c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.255900 May 24 13:57:39.903905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 108/222] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:39 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:39.996582 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:40.005741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-342fb510-9cc2-4e52-aa2d-537a92aea1e8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1501 microversion: 2.1 time: 0.225286 May 24 13:57:40.006575 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 115/223] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:39 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:40.024198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcb05da4-1816-4254-bf1a-9bba1dd46dc7"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:40.025305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:40.032280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.032733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.033512 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.033943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.084974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] HTTP exception thrown: Cannot 'attach_volume' instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 while it is in vm_state rescued May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Request method failure captured: May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/os-volume_attachments HTTP/1.1 May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 74 May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPh81quQjnD-qmdosxKbMMw-h-WryCXpaNbCqNl1mGxuZnbA1wePY8nRZkc94zTX7ff-on65-_evJ5KGEs43TvjvpPHl93PvGkREv1jt67q2qiB2Y4qHvYsNPlVE4KsMHNJqUQexrkRXstmH5S3SWH3r8FLj1FMkfJQqGtZXNI6H4A May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 54ee7d13408645e6b6517f541fe45670 May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:57:40.087786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_54ee7d13408645e6b6517f541fe45670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 54ee7d13408645e6b6517f541fe45670 May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 532b36f272dc432aad6faa294bd1bc6c May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {"volumeAttachment": {"volumeId": "bcb05da4-1816-4254-bf1a-9bba1dd46dc7"}} May 24 13:57:40.089277 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Cannot 'attach_volume' instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 while it is in vm_state rescued May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'server_id': '2f19875e-64fa-4a59-9a45-a3d6e7ae96d6', 'body': {'volumeAttachment': {'volumeId': 'bcb05da4-1816-4254-bf1a-9bba1dd46dc7'}}} May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:57:40.090489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 while it is in vm_state rescued May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:57:40.091659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:57:40.094372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:57:40.094372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:57:40.094372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 while it is in vm_state rescued May 24 13:57:40.094372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:57:40.099160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Returning 409 to user: Cannot 'attach_volume' instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 while it is in vm_state rescued {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:57:40.099160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-22ebe946-876f-4ee8-b36f-22d42850fbda tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079012 May 24 13:57:40.100264 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 109/224] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 13:57:40 2022] POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 13:57:40.110258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:40.111067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:40.118716 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.119522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.120578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.122583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.218232 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-87ad4ec9-d5b9-41a6-9ade-3d910e5b8191 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/action" status: 202 len: 0 microversion: 2.1 time: 0.112979 May 24 13:57:40.220011 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 116/225] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 13:57:40 2022] POST /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 13:57:40.232462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:40.233103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:40.239496 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.239985 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.240869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.241385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.395461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:40.403132 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2ab27222-282e-4257-90fe-97ed8ecc1e01 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.177833 May 24 13:57:40.404140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 110/226] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:40 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:40.921378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:40.922790 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:40.941351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.942558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:40.944236 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:40.945126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:41.097145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:41.108760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-56b3c8ff-62f9-41b7-8f73-a033c1d5b41c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.192078 May 24 13:57:41.109413 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 117/227] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:40 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:41.427765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:41.429081 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:41.437970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:41.438751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:41.439805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:41.440491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:41.460483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:41.678066 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:41.694993 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a2d0c2aa-9951-4a9c-897f-1171b4bb90b2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.277179 May 24 13:57:41.698066 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 111/228] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:41 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:42.127162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:42.127643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:42.142534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:42.142534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:42.142534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:42.142534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:42.285316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:42.443865 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=8 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:42.715146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:42.715859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:42.726021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:42.726484 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:42.727329 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:42.728026 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:43.007215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:43.016677 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8edb3a66-1101-4d0e-bdfb-7dbe6f0716c5 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.895039 May 24 13:57:43.026878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 118/229] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:42 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:43.076259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:43.085904 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e2e2f566-241e-4995-a45e-54ce62e416bd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.375095 May 24 13:57:43.086496 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 112/230] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:42 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:44.034500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:44.036022 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:44.045459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:44.045921 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:44.049486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:44.050070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:44.109226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:44.110560 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:44.119591 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:44.120540 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:44.121385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:44.121925 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:44.308462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:44.321765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7f6cb13d-5b60-4cf5-922d-77e603f9edc3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.221517 May 24 13:57:44.322366 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 113/231] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:44 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:44.505704 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:44.514401 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6394b0a0-2752-4c21-b206-10eb663893a8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.483562 May 24 13:57:44.517917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 119/232] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:44 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:45.339703 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:45.340433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:45.346485 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:45.347017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:45.348526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:45.349361 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:45.534651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:45.537026 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:45.544194 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:45.545072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:45.546058 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:45.547284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:45.741238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:45.752769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0479e86f-1297-46e6-94ca-9f937996bb3e tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.222428 May 24 13:57:45.762772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 120/233] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:45 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:45.801569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-838420216", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "networks": [{"uuid": "f063f9ef-2098-4bf4-a44f-09110a7a9fdf"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:45.870209 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] validate_networks() for [('f063f9ef-2098-4bf4-a44f-09110a7a9fdf', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:57:45.960115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:45.972859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-577c2f67-6f29-41e9-82de-cde4da0838da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.634632 May 24 13:57:45.973930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 114/234] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:45 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:46.340162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:57:46.340792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:57:46.341270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:57:46.341677 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:57:46.342100 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:57:46.356459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:46.356936 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:46.357781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:46.358233 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:46.382698 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Getting quotas for project b8708171d18747eda57bed0a3cb3030b. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:46.394024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Getting quotas for user ca15829f779b403d8a78940b17dccf6a and project b8708171d18747eda57bed0a3cb3030b. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:46.415720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:57:46.418287 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:57:46.479504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-36f1bb35-ae24-491e-ae4b-3c2d66e4263e tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681899 May 24 13:57:46.480613 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 121/235] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:57:46.495011 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-aacd4818-06a3-49c5-8343-697a074fd69a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:46.496287 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-aacd4818-06a3-49c5-8343-697a074fd69a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:46.591346 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-aacd4818-06a3-49c5-8343-697a074fd69a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:46.611388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-aacd4818-06a3-49c5-8343-697a074fd69a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1213 microversion: 2.1 time: 0.124300 May 24 13:57:46.634989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 115/236] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:46 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:46.776694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:46.778213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:46.796974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:46.798398 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:46.802053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:46.804511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:47.002739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:47.007596 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:47.016950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:47.018058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:47.020007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:47.025143 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:47.025880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:47.027423 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5ef967d8-5470-4013-8126-def0cd153dcb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.259980 May 24 13:57:47.037140 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 122/237] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:46 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:47.288059 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:47.296372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bb8bd083-4ca8-4839-a3b9-8f311e857c78 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.309434 May 24 13:57:47.297475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 116/238] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:46 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:47.650746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:47.651351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:47.659435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:47.659923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:47.661240 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:47.661672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:47.735334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:47.744123 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d507d1b6-e31b-4c93-98a5-183ce2f10e09 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1217 microversion: 2.1 time: 0.097236 May 24 13:57:47.744683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 123/239] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:47 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:48.047186 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:48.047920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:48.054232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:48.054664 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:48.055439 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:48.056272 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:48.243944 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:48.252976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-192237b9-9591-447c-9275-b8c41c68d6dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.210731 May 24 13:57:48.254378 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 117/240] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:48 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:48.314256 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:48.315097 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:48.323847 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:48.324418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:48.325286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:48.325877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:48.491369 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:48.499511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-14a0bdca-97d9-466c-ae3b-94b14800b804 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.189328 May 24 13:57:48.500269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 124/241] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:48 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:48.761094 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:48.761996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:48.768186 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:48.768828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:48.769907 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:48.770507 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:48.845876 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:48.864201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9ca65629-299d-4eef-a991-72a1c8934494 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1217 microversion: 2.1 time: 0.100346 May 24 13:57:48.864201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 118/242] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:48 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:49.272840 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:49.273771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:49.281274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:49.282007 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:49.283026 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:49.283663 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:49.523739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:49.525042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:49.532732 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:49.533481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:49.534499 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:49.564110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:49.833559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:49.856566 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fef8b8fc-15b3-4bc3-bbc7-42e7ae5c3cd8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.587540 May 24 13:57:49.858656 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 125/243] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:49 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:49.888904 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:49.890061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:49.894098 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:49.909087 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-64140a35-9200-4dfc-ade5-3b5e1aed8655 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1509 microversion: 2.1 time: 0.394544 May 24 13:57:49.912418 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 119/244] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:49 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:49.915285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:49.915745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:49.918302 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:49.918756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:50.216797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:50.225110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1c4bfa19-313d-41e4-95c2-cafc351ff540 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1265 microversion: 2.1 time: 0.348966 May 24 13:57:50.226269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 126/245] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:49 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:50.875392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:50.876578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:50.887487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:50.890162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:50.891149 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:50.891747 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:50.938511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:50.940212 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:50.953245 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:50.954425 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:50.955971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:50.957044 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:51.197461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:51.207902 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-48ecfdeb-3133-4044-af56-b27c35316626 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.334883 May 24 13:57:51.209847 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 120/246] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:50 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:51.243628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:51.244271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:51.255244 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:51.258594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:51.259555 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:51.260388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:51.434315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:51.447043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3a6658f4-3df6-4d38-bcfb-bd14816b5327 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1271 microversion: 2.1 time: 0.207669 May 24 13:57:51.447991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 121/247] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:51 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:51.648972 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:51.661496 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8b09d543-68c5-4184-899a-ee15c4f3f6bb tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1515 microversion: 2.1 time: 0.736198 May 24 13:57:51.667668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 127/248] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:50 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1515 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:52.226517 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:52.227374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:52.242754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:52.243301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:52.244219 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:52.244766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:52.468180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:52.468887 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:52.479697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:52.485380 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:52.486605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:52.488510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:52.767778 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:52.781765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-66fb59b0-49e8-43fd-82d7-972b641cd5cb tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.560382 May 24 13:57:52.789359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 122/249] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:52 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:53.187599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:53.196905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4629759d-fc7a-41f6-ac69-8e21e20fb6ce tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.733594 May 24 13:57:53.202879 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 128/250] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:52 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:53.531764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-5075326a-00b9-4af6-a0f7-798800415098 req-8f041de1-d52b-4cb0-a60d-3df45f0e29dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86c9f2c-6076-42d9-95e1-c4781db7982b", "name": "network-vif-plugged", "status": "completed", "tag": "5efa9fbc-615b-4396-bd55-339ba5728851"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:53.549736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-5075326a-00b9-4af6-a0f7-798800415098 req-8f041de1-d52b-4cb0-a60d-3df45f0e29dd service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:53.563218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-5075326a-00b9-4af6-a0f7-798800415098 req-8f041de1-d52b-4cb0-a60d-3df45f0e29dd service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:53.578720 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-5075326a-00b9-4af6-a0f7-798800415098 req-8f041de1-d52b-4cb0-a60d-3df45f0e29dd service nova] Creating event network-vif-plugged:5efa9fbc-615b-4396-bd55-339ba5728851 for instance d86c9f2c-6076-42d9-95e1-c4781db7982b on hv-cinder-84212 May 24 13:57:53.588016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-5075326a-00b9-4af6-a0f7-798800415098 req-8f041de1-d52b-4cb0-a60d-3df45f0e29dd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064518 May 24 13:57:53.589646 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 123/251] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:57:53.807195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:53.808888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:53.824318 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:53.835339 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:53.848795 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:53.849898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:53.913967 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:54.049771 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-3ab077e4-e3d8-4180-bfcd-7d2fba08eb91 req-097a5df5-0103-4310-99c5-9fb878943385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f11425-3efc-4ac0-88dd-449b0180843e", "tag": "92d0feca-c6fc-482a-9c90-d85a60c51e31"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:54.085248 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-3ab077e4-e3d8-4180-bfcd-7d2fba08eb91 req-097a5df5-0103-4310-99c5-9fb878943385 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:54.112327 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-3ab077e4-e3d8-4180-bfcd-7d2fba08eb91 req-097a5df5-0103-4310-99c5-9fb878943385 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:54.143863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-3ab077e4-e3d8-4180-bfcd-7d2fba08eb91 req-097a5df5-0103-4310-99c5-9fb878943385 service nova] Creating event network-changed:92d0feca-c6fc-482a-9c90-d85a60c51e31 for instance 67f11425-3efc-4ac0-88dd-449b0180843e on hv-cinder-84212 May 24 13:57:54.149978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-3ab077e4-e3d8-4180-bfcd-7d2fba08eb91 req-097a5df5-0103-4310-99c5-9fb878943385 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105162 May 24 13:57:54.151161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 124/252] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:54.221573 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:54.222821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:54.263154 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:54.265607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:54.268700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:54.270001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:54.573449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:54.582168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c8ffb6e2-3d37-43a1-a966-30f3fa309b69 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.778650 May 24 13:57:54.597076 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 129/253] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:53 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:54.685836 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8b753c15-2c48-43a9-9b78-6f7fbcc78568 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'create', calling method: .version_select at 0x7f33b59d4940>, body: {"keypair": {"name": "tempest-keypair-1410042429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOiGhScqRFSBTEQZcedZjWNkM0UWbLJUBWR+wLsiffZet1yGED9+lSNfPaZUhLE/PaYz9U1hDAb+ABVtuBQ4SntrECSuf46+r6JT7RAe66D+DEhF6JtNHSKcZcRDDROpA=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:54.730251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-8b753c15-2c48-43a9-9b78-6f7fbcc78568 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for project 54ee7d13408645e6b6517f541fe45670. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:54.741574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-8b753c15-2c48-43a9-9b78-6f7fbcc78568 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for user 532b36f272dc432aad6faa294bd1bc6c and project 54ee7d13408645e6b6517f541fe45670. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:54.808252 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8b753c15-2c48-43a9-9b78-6f7fbcc78568 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126207 May 24 13:57:54.812475 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 130/254] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 13:57:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:54.881762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:54.896917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e0dea9b7-9e70-47a5-b503-6cce7544c086 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.680263 May 24 13:57:54.906990 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 125/255] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:54 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:55.605239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:55.608696 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:55.616325 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:55.617064 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:55.618010 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:55.618969 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:55.914775 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:55.915414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:55.927049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:55.927990 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:55.928940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:55.932182 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:56.024946 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:56.040153 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-02a88783-8add-44db-94e9-f5a5984b6eb7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.435643 May 24 13:57:56.041043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 131/256] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:55 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:56.144799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:56.156797 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-02ffb156-c0be-4726-bf4d-6bd842f77605 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.245623 May 24 13:57:56.164928 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 126/257] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:55 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:57:56.977295 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:57.057312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:57.058042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:57.067868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:57.071261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:57.071708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:57.072714 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:57.073327 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:57.259512 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:57.268644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0faca085-ac45-4d93-b805-eee79791da27 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.215190 May 24 13:57:57.270875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 127/258] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:57 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:57.286617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:57.287490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:57.294573 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:57.295222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:57.296198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:57.296782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:57.322815 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6c57e0af-2f3e-45e8-abd9-da284bc9403b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Action: 'create', calling method: .version_select at 0x7f33b59be0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-131305348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRXjUNK/HcPqjFMylpudBwGMGAVO/80PCrGoLQhB2tZ0ZIWEsx3epD2XRdxanZJbOKNjDbB0bc7zH703XxHqp9R8efgyQey/wSI1oKqTX4dvrSOtMjePpDgff/bNSSlUw=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:57.337081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-6c57e0af-2f3e-45e8-abd9-da284bc9403b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:57.340889 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-6c57e0af-2f3e-45e8-abd9-da284bc9403b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for user 3acb774848a74e74a5886ee681ed205c and project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:57.367911 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6c57e0af-2f3e-45e8-abd9-da284bc9403b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.394920 May 24 13:57:57.374475 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 132/259] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 13:57:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:57:57.382324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-159297512", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0e72eb5-e496-4ebe-ba03-7c3c8ffdbca9"}], "security_groups": [{"name": "tempest-securitygroup--1356539674"}], "key_name": "tempest-keypair-1410042429", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:57:57.461506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:57.469673 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a566d404-4c9f-4b04-af44-fc71b636671d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.197535 May 24 13:57:57.470369 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 128/260] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:57 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:57.561215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] validate_networks() for [('c0e72eb5-e496-4ebe-ba03-7c3c8ffdbca9', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:57:58.059865 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:57:58.060293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:57:58.060776 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:57:58.061185 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:57:58.061597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:57:58.074804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:58.075994 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:58.077110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:58.077634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:58.105670 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for project 54ee7d13408645e6b6517f541fe45670. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:57:58.112005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Getting quotas for user 532b36f272dc432aad6faa294bd1bc6c and project 54ee7d13408645e6b6517f541fe45670. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:57:58.130460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:57:58.132641 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:57:58.189603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-804683c9-87b1-4850-90f1-ad40dd65995f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.818944 May 24 13:57:58.190542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 133/261] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:57:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 13:57:58.202552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-812ce8dd-2fe2-4540-8856-abb7bb657a00 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:58.203160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-812ce8dd-2fe2-4540-8856-abb7bb657a00 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:58.290525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:58.291144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:58.302814 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:58.303330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:58.304181 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:58.311709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:58.358522 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-812ce8dd-2fe2-4540-8856-abb7bb657a00 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:58.370624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-812ce8dd-2fe2-4540-8856-abb7bb657a00 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1245 microversion: 2.1 time: 0.172834 May 24 13:57:58.371232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 129/262] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:58 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1245 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:58.489103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:58.490166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:58.513888 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:58.524878 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:58.526210 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:58.527923 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:58.630752 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:58.647710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0d1b2013-9766-4b74-8805-fc6f11ed15dd tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1315 microversion: 2.1 time: 0.363346 May 24 13:57:58.649458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 134/263] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:58 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:58.754367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:58.766731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-94c11ed5-2153-4474-9fbc-59931095978f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.283188 May 24 13:57:58.769464 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 130/264] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:58 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:59.396645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:59.403208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:59.407129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:59.416091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:59.416728 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:59.417851 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:59.429314 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:59.516820 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:57:59.527932 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a973804a-7b53-425d-b3d9-a7d44da1c7dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1249 microversion: 2.1 time: 0.135568 May 24 13:57:59.528607 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 135/265] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:59 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:57:59.665469 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:59.666086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:59.674284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:59.674839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:59.675764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:59.677037 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:59.696288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:57:59.785795 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:57:59.786966 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:57:59.802668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:59.804473 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:57:59.805833 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:57:59.807326 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.105499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:00.115280 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c6a2f608-6c00-4e6c-9ce0-5e1062dbcc13 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.333621 May 24 13:58:00.115893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 136/266] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:59 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:00.121821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:00.133373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-acf41088-d34d-4bb7-84d0-02168a3fe71f tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1465 microversion: 2.1 time: 0.471745 May 24 13:58:00.134309 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 131/267] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:57:59 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1465 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:00.183775 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:00.184362 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:00.193050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:00.194312 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.195099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:00.195536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.220878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:58:00.326594 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8081e1b0-752d-415e-9e9d-f8c292df0928 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 204 len: 0 microversion: 2.1 time: 0.146834 May 24 13:58:00.327283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 137/268] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 13:58:00 2022] DELETE /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:58:00.336002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:00.336637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:00.342848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:00.343298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.344119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:00.344556 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.515306 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:00.523621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-96b5561a-d1e9-47a7-a9a8-f41dc0ebe9c8 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.191526 May 24 13:58:00.525326 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 132/269] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:00 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:00.545982 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:00.546758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:00.554626 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:00.555086 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.556100 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:00.556547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:00.623227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:00.631324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-17d448d6-0ce7-4d89-b437-390c626c8420 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1305 microversion: 2.1 time: 0.089645 May 24 13:58:00.631916 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 138/270] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:00 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:01.132969 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:01.133580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:01.139938 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:01.140493 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:01.141330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:01.142209 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:01.285583 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:01.294204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5d159a15-5d82-4efa-b960-06679ff6206a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.164975 May 24 13:58:01.294801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 133/271] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:01 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:01.542643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:01.543273 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:01.549249 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:01.549779 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:01.551393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:01.551922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:01.652721 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:01.653416 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:01.660412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:01.660977 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:01.662247 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:01.662971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:01.790536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:01.799616 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8a2f385c-0dfe-4f38-8796-3e71fe05e9b4 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.260729 May 24 13:58:01.809371 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:01.809967 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 139/272] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:01 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:01.811865 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b60ceb11-791a-442c-8eff-31b1fa6d7455 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1305 microversion: 2.1 time: 0.167682 May 24 13:58:01.820221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 134/273] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:01 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:02.312243 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:02.312941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:02.320813 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:02.321363 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:02.322191 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:02.322624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:02.456282 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:02.463780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-111d4016-f2be-4735-8c96-23ff2442540f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.155591 May 24 13:58:02.464371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 140/274] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:02 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:02.817298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:02.817939 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:02.824031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:02.824489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:02.825249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:02.825682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:02.829137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:02.829771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:02.836569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:02.837013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:02.837781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:02.838214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:02.901976 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:02.909969 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f2610e77-246c-4165-abdf-96e31f1c441c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1303 microversion: 2.1 time: 0.084018 May 24 13:58:02.910552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 141/275] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:02 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:02.961252 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:02.969052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-00e2dd56-97da-4d90-8323-dd5582108c64 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.155894 May 24 13:58:02.969634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 135/276] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:02 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:03.481128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:03.481792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:03.487724 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:03.488198 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:03.489563 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:03.489999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:03.621438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:03.629036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eed2cb79-f68f-4f78-9c84-786b886877a7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.151722 May 24 13:58:03.630206 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 142/277] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:03 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:03.927259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:03.928056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:03.934046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:03.934485 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:03.935260 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:03.935688 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:03.986665 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:03.987376 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:03.994549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:03.995065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:03.995978 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:03.996415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:03.996569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:04.004199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-404c377f-b274-48ef-a44e-4a7778e8e572 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1303 microversion: 2.1 time: 0.081545 May 24 13:58:04.004775 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 136/278] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:03 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1303 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:04.133314 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:04.140696 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f6b4ae23-3525-455d-ac3a-2b45f0182618 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.157874 May 24 13:58:04.141260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 143/279] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:03 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:04.646049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:04.646585 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:04.652669 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:04.653116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:04.653896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:04.654328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:04.785543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:04.794198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-80fb857c-a80b-4a56-a69e-34655c828d8d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.152100 May 24 13:58:04.794763 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 137/280] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:04 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:05.021675 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:05.022284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:05.028944 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:05.029397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:05.030167 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:05.030602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:05.095873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:05.104263 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-74b4441f-f84c-436d-91b0-b4f760f0f56f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1303 microversion: 2.1 time: 0.087044 May 24 13:58:05.104845 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 144/281] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:05 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:05.158674 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:05.159523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:05.166571 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:05.167013 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:05.167776 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:05.168230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:05.298863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:05.306455 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-08e249f3-f436-4715-9ba6-aabe393a704c tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.152417 May 24 13:58:05.307017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 138/282] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:05 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:05.811611 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:05.812260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:05.819108 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:05.819555 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:05.820344 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:05.820781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:05.963670 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:05.971118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-71676c89-d37b-4354-8dc2-893dc675adad tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.163222 May 24 13:58:05.971688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 145/283] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:05 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:06.121332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:06.121858 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:06.123692 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=72 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:06.130195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:06.130654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:06.131426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:06.131884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:06.200886 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:06.208790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f5793327-d4d5-4934-96e7-4b7bae9d359e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1303 microversion: 2.1 time: 0.091336 May 24 13:58:06.209360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 139/284] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:06 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:06.325414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:06.326014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:06.332490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:06.333056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:06.334056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:06.334491 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:06.462922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:06.470207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-46acce1c-40b2-4e5b-b6ee-de77581be4d7 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.149245 May 24 13:58:06.470766 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 146/285] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:06 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:06.987848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:06.988460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:06.994638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:06.995087 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:06.995905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:06.996342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:07.130631 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:07.138013 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ad3cd6b2-d580-4c6a-bd0c-707f1c6e91f0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.154114 May 24 13:58:07.138582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 140/286] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:06 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:07.225728 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:07.227935 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:07.234023 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:07.234468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:07.235236 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:07.235669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:07.240434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:07.303025 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:07.310577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0357fd1c-f281-4a13-bb26-98aaff394a1a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1303 microversion: 2.1 time: 0.088918 May 24 13:58:07.311316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 147/287] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:07 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:07.489608 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:07.490295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:07.497792 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:07.498527 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:07.499308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:07.499744 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:07.630735 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:07.638361 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a9dafaae-ed52-4c81-a692-83de9cd5218b tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.153289 May 24 13:58:07.638941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 141/288] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:07 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:08.155306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:08.155880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:08.158199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:08.158859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=20 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:08.166116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:08.166668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:08.167500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:08.167974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:08.302706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:08.310062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ef08cc59-1e63-47de-9ef2-05ab0ad91c25 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.158993 May 24 13:58:08.310632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 148/289] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:08 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:08.328373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:08.328977 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:08.335746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:08.336211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:08.336958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:08.337409 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:08.367118 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:08.399876 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:08.407377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3256b366-1ec4-47cc-ba85-89f05c84c880 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1303 microversion: 2.1 time: 0.082757 May 24 13:58:08.407937 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 142/290] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:08 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:08.656106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:08.656708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:08.663103 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:08.663579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:08.664361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:08.664907 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:08.793979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:08.802091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4598b384-f2eb-4a5e-8eba-df9e075b3c93 tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.149884 May 24 13:58:08.802658 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 149/291] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:08 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:09.326964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:09.327590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:09.338045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:09.338493 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:09.339263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:09.339694 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:09.424746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:09.430618 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:09.447467 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:09.448280 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:09.449401 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:09.449974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:09.657560 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:09.667008 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1126dce4-91bf-4c31-8e8b-9edd7a9a5a89 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.343978 May 24 13:58:09.667993 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 143/292] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:09 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:09.819224 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:09.819996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:09.826575 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:09.827029 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:09.827811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:09.828278 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:10.008160 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:10.021934 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-73f45107-55d6-4b0b-a033-0de58239c0a0 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.601382 May 24 13:58:10.028748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 150/293] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:09 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:10.054111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7a80142b-a480-4084-9c60-8bafb6ad5acd req-0990251a-f408-4c95-ab3e-df67e0f9f621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86c9f2c-6076-42d9-95e1-c4781db7982b", "name": "network-vif-deleted", "tag": "5efa9fbc-615b-4396-bd55-339ba5728851"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:10.087999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7a80142b-a480-4084-9c60-8bafb6ad5acd req-0990251a-f408-4c95-ab3e-df67e0f9f621 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:10.088465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7a80142b-a480-4084-9c60-8bafb6ad5acd req-0990251a-f408-4c95-ab3e-df67e0f9f621 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:10.104651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7a80142b-a480-4084-9c60-8bafb6ad5acd req-0990251a-f408-4c95-ab3e-df67e0f9f621 service nova] Creating event network-vif-deleted:5efa9fbc-615b-4396-bd55-339ba5728851 for instance d86c9f2c-6076-42d9-95e1-c4781db7982b on hv-cinder-84212 May 24 13:58:10.112666 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7a80142b-a480-4084-9c60-8bafb6ad5acd req-0990251a-f408-4c95-ab3e-df67e0f9f621 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065390 May 24 13:58:10.117315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 151/294] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:10.123483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60bbd2f0609b4b8d81c9db106408eba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '456ea6bbe702420cb7fa4284088efda2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:10.136004 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5e729754-95e2-473b-9ee4-3ef58ce2848a tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 200 len: 1471 microversion: 2.1 time: 0.321085 May 24 13:58:10.138487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 144/295] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:09 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:10.270066 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-706c2e74-0f48-42ca-9c95-69dd1eaa1a1b req-f2fa30e9-e0ff-4985-b95b-335d6c2a81c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f11425-3efc-4ac0-88dd-449b0180843e", "name": "network-vif-plugged", "status": "completed", "tag": "92d0feca-c6fc-482a-9c90-d85a60c51e31"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:10.279917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-706c2e74-0f48-42ca-9c95-69dd1eaa1a1b req-f2fa30e9-e0ff-4985-b95b-335d6c2a81c6 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:10.280457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-706c2e74-0f48-42ca-9c95-69dd1eaa1a1b req-f2fa30e9-e0ff-4985-b95b-335d6c2a81c6 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:10.292364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-706c2e74-0f48-42ca-9c95-69dd1eaa1a1b req-f2fa30e9-e0ff-4985-b95b-335d6c2a81c6 service nova] Creating event network-vif-plugged:92d0feca-c6fc-482a-9c90-d85a60c51e31 for instance 67f11425-3efc-4ac0-88dd-449b0180843e on hv-cinder-84212 May 24 13:58:10.299282 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-706c2e74-0f48-42ca-9c95-69dd1eaa1a1b req-f2fa30e9-e0ff-4985-b95b-335d6c2a81c6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 May 24 13:58:10.300058 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 152/296] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:10.684022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:10.687685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:10.696978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:10.697625 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:10.698778 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:10.699298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:10.771559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-97f02d23-2151-4a4d-a434-30ecf7b80a47 req-3b3b04de-143a-4825-be1b-defc284980bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efba3b6-0b80-48c5-ac89-0db944e2ac8f", "tag": "6ec58c80-6380-4300-8c4d-013be3a1d9bb"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:10.783394 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-97f02d23-2151-4a4d-a434-30ecf7b80a47 req-3b3b04de-143a-4825-be1b-defc284980bd service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:10.784267 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-97f02d23-2151-4a4d-a434-30ecf7b80a47 req-3b3b04de-143a-4825-be1b-defc284980bd service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:10.804931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-97f02d23-2151-4a4d-a434-30ecf7b80a47 req-3b3b04de-143a-4825-be1b-defc284980bd service nova] Creating event network-changed:6ec58c80-6380-4300-8c4d-013be3a1d9bb for instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f on hv-cinder-84212 May 24 13:58:10.815600 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-97f02d23-2151-4a4d-a434-30ecf7b80a47 req-3b3b04de-143a-4825-be1b-defc284980bd service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050079 May 24 13:58:10.817280 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 153/297] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:11.008455 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:11.029643 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fd8ddca1-e68d-44e2-b8cf-8507fe2e90b3 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.349978 May 24 13:58:11.031139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 145/298] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:10 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:11.045702 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:11.046392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:11.052769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:11.053237 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:11.054009 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:11.054448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:11.157920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:11.158536 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] [instance: d86c9f2c-6076-42d9-95e1-c4781db7982b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:11.165570 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:11.166047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:11.167134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:11.167761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:11.182080 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] HTTP exception thrown: Instance d86c9f2c-6076-42d9-95e1-c4781db7982b could not be found. May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Request method failure captured: May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b HTTP/1.1 May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOREJEEVNTDeXqTD-5u3D-UAngUlF3jOUtlOFbSrYpBuEc8ENO44TgY4Lxgq-sj60A1y_eLH93--BMC-fvUX-a0fGSReaLAvW06IMmz_UC4EFQPLedBT_UAg9dm144QfRjwyquZNOMSUbCUpPGSKqlB3PinSbKySHCTsm_RP-_pi5xY May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 456ea6bbe702420cb7fa4284088efda2 May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesNegativeTest-1447024781 May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:58:11.186114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_456ea6bbe702420cb7fa4284088efda2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/456ea6bbe702420cb7fa4284088efda2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/456ea6bbe702420cb7fa4284088efda2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/456ea6bbe702420cb7fa4284088efda2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesNegativeTest-1447024781 May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 456ea6bbe702420cb7fa4284088efda2 May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesNegativeTest-1447024781 May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesNegativeTest-1447024781-project May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 60bbd2f0609b4b8d81c9db106408eba8 May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesNegativeTest-1447024781-project May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance d86c9f2c-6076-42d9-95e1-c4781db7982b could not be found. May 24 13:58:11.188103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': 'd86c9f2c-6076-42d9-95e1-c4781db7982b'} May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86c9f2c-6076-42d9-95e1-c4781db7982b could not be found. May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:58:11.189106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86c9f2c-6076-42d9-95e1-c4781db7982b could not be found. May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86c9f2c-6076-42d9-95e1-c4781db7982b could not be found. May 24 13:58:11.190535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:11.193457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] Returning 404 to user: Instance d86c9f2c-6076-42d9-95e1-c4781db7982b could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:58:11.193457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-654c7d48-f2da-457f-9aaf-d1a7687ee4ba tempest-VolumesNegativeTest-1447024781 tempest-VolumesNegativeTest-1447024781-project] 10.222.0.24 "GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b" status: 404 len: 111 microversion: 2.1 time: 0.031998 May 24 13:58:11.193457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 146/299] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:11 2022] GET /compute/v2.1/servers/d86c9f2c-6076-42d9-95e1-c4781db7982b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:58:11.205674 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:11.213938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9b290b60-3bc0-4f3a-a4f7-cb252a09080b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.172426 May 24 13:58:11.214523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 154/300] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:11 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:12.049619 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:12.050332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:12.057741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:12.058185 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:12.058958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:12.059391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:12.215131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:12.223298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6751169c-4763-4f1c-ab3e-3aa59d83fb6a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.178430 May 24 13:58:12.224117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 147/301] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:12 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:12.234860 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:12.235575 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:12.242882 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:12.243504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:12.244235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:12.244672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:12.394160 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:12.403390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c5074cf1-65f5-4c9b-93b1-d8e6b7cf92a2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.172710 May 24 13:58:12.403991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 155/302] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:12 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:13.240437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:13.241052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:13.247116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:13.247671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:13.248460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:13.248894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:13.388607 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:13.390785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:13.397379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e3ebc15b-372b-4401-815c-da2e5e02bdda tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.161361 May 24 13:58:13.397949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 148/303] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:13 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:13.426477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:13.427156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:13.433838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:13.434294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:13.435070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:13.435512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:13.594034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:13.602002 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c763daf1-1c47-42b5-8ed2-654495d1966c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.185381 May 24 13:58:13.602600 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 156/304] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:13 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:14.413500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:14.414108 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:14.420133 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:14.420585 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:14.421341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:14.421779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:14.556262 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:14.563642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d25bdade-94a6-4dda-ae59-cd171410e507 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.153933 May 24 13:58:14.564358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 149/305] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:14 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:14.618539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:14.619158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:14.625699 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:14.626414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:14.627182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:14.627621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:14.759215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:14.766719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ef4b7cda-9bd5-4b59-b72d-e5a93c974d47 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.152014 May 24 13:58:14.767300 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 157/306] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:14 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:15.584116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:15.584725 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:15.591057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:15.591434 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:15.592222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:15.592651 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:15.732451 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:15.743365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-82558557-2b1c-45a2-8594-2cba3d27b2cc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.163332 May 24 13:58:15.744345 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 150/307] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:15 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:15.784340 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:15.784967 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:15.796436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:15.797684 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:15.798755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:15.799406 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:15.964277 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:15.972824 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f82186a5-d586-4871-8fd7-297b82525ff6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.192924 May 24 13:58:15.982743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 158/308] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:15 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:16.764098 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:16.764716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:16.774012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:16.774700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:16.775378 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:16.775954 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:16.917377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:16.924746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-68907e7f-d62b-42dc-8204-d4a5fac0918a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1313 microversion: 2.1 time: 0.165143 May 24 13:58:16.925510 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 151/309] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:16 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:16.994474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:16.994474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:16.999269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:16.999916 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:17.000811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:17.001729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:17.149446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:17.156970 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9104bb49-d12e-426a-947c-122ec2122b02 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.170458 May 24 13:58:17.157530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 159/310] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:16 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:17.943076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:17.943672 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:17.951432 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:17.951903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:17.952668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:17.953097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:18.094718 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:18.102275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9017da72-a987-4a4a-9cfa-377e5d7cd19b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1497 microversion: 2.1 time: 0.163762 May 24 13:58:18.102843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 152/311] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:17 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:18.174529 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:18.175137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:18.182381 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:18.182839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:18.183985 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:18.184365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:18.432884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-176ed7b6-eceb-484f-b993-810ece929e39 req-06da53a9-e999-4464-a4c8-65023aad249f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efba3b6-0b80-48c5-ac89-0db944e2ac8f", "name": "network-vif-plugged", "status": "completed", "tag": "6ec58c80-6380-4300-8c4d-013be3a1d9bb"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:18.445053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:18.447513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-176ed7b6-eceb-484f-b993-810ece929e39 req-06da53a9-e999-4464-a4c8-65023aad249f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:18.448101 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-176ed7b6-eceb-484f-b993-810ece929e39 req-06da53a9-e999-4464-a4c8-65023aad249f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:18.460335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8bb3a2d0-947f-4ed4-acf1-d21b16f9ce2a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.289943 May 24 13:58:18.462439 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 160/312] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:18 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:18.463038 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-176ed7b6-eceb-484f-b993-810ece929e39 req-06da53a9-e999-4464-a4c8-65023aad249f service nova] Creating event network-vif-plugged:6ec58c80-6380-4300-8c4d-013be3a1d9bb for instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f on hv-cinder-84212 May 24 13:58:18.468874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-176ed7b6-eceb-484f-b993-810ece929e39 req-06da53a9-e999-4464-a4c8-65023aad249f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041965 May 24 13:58:18.472246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 153/313] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:58:19.019860 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:19.021241 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:19.027808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:19.028172 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:19.028953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:19.029392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:19.060174 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:58:19.137934 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ba88021e-aa2b-484e-b536-e946483929fe tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "DELETE /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 204 len: 0 microversion: 2.1 time: 0.126559 May 24 13:58:19.138593 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 161/314] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 13:58:19 2022] DELETE /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:58:19.149782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:19.150481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:19.156619 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:19.157067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:19.157825 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:19.158255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:19.290839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:19.298417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-81a64ca3-21e8-4a19-94ac-98e9708eb5d0 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.153890 May 24 13:58:19.298983 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 154/315] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:19 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:19.479568 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:19.480291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:19.486341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:19.486785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:19.487765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:19.488193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:19.650078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:19.657564 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-766166a0-01a3-4dce-80ee-5119ba7d7e0d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.182151 May 24 13:58:19.658148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 162/316] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:19 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:20.315840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:20.316537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:20.323402 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:20.323877 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:20.324648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:20.325086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:20.455862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:20.464057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e6e30e1c-fdc5-41bf-9062-5849993edb33 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.152491 May 24 13:58:20.464624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 155/317] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:20 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:20.674247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:20.674860 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:20.681250 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:20.681761 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:20.682465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:20.683106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:20.819952 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:20.827523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2aa6b10d-5f2d-4b04-9dc0-1e46a3468ed7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.157012 May 24 13:58:20.828058 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 163/318] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:20 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:21.482025 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:21.482589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:21.488627 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:21.489273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:21.490048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:21.490480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:21.624989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:21.633384 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1870190f-5f9e-46b3-b8d7-87844ae7b114 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.155427 May 24 13:58:21.633949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 156/319] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:21 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:21.845069 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:21.845697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:21.852219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:21.852673 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:21.853428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:21.853862 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:21.858279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:21.985294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:21.993574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-343d1042-12e3-44b4-8b80-107a01d0da3c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.152444 May 24 13:58:21.994130 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 164/320] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:21 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:22.650202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:22.650806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:22.657364 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:22.657812 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:22.658578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:22.659012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:22.802129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:22.810080 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5d5b2137-2c16-40a7-8e73-17a76b2b1c1f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.164565 May 24 13:58:22.810655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 157/321] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:22 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:23.011372 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:23.012137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:23.018554 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:23.018997 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:23.019797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:23.020205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:23.149946 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:23.157466 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-92ae30bb-887a-43af-b5f7-12294bb7af53 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.150192 May 24 13:58:23.158021 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 165/322] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:23 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:23.826475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:23.827080 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:23.835476 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:23.835981 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:23.836953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:23.837395 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:23.975705 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:23.983294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3b3692d5-7b1f-4ca4-bcc7-276621b04171 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.160669 May 24 13:58:23.983900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 158/323] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:23 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:24.174092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:24.174693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:24.181945 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:24.182391 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:24.183148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:24.183581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:24.317389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:24.326128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-897920df-2fa2-412a-904a-a17bf13b1419 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.155747 May 24 13:58:24.326696 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 166/324] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:24 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:25.000432 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:25.001321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:25.008121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:25.008576 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:25.009351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:25.009792 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:25.142139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:25.150160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-81a07c03-7b4b-44d3-bdfa-0fe58db12f2f tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.153809 May 24 13:58:25.150731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 159/325] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:24 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:25.342993 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:25.343550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:25.353471 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:25.354295 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:25.355081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:25.355523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:25.490390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:25.497730 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f2922369-fb5d-456c-947b-4f91295790f2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.158663 May 24 13:58:25.498305 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 167/326] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:25 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:26.167342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:26.167989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:26.174045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:26.174497 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:26.175258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:26.175696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:26.310638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:26.318645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-79e44a09-8c44-47fa-b828-5a4e74c65b08 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.155157 May 24 13:58:26.319233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 160/327] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:26 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:26.515324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:26.515950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:26.523595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:26.524066 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:26.524828 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:26.525262 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:26.660968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:26.669035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-037d4eeb-84e6-4691-b6fb-18cee9dadef2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.157677 May 24 13:58:26.669610 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 168/328] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:26 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:27.336979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:27.337583 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:27.343595 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:27.344083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:27.344840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:27.345270 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:27.475492 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:27.482900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fa3c7f75-ed84-45c3-8be3-1f65e51290df tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.150484 May 24 13:58:27.483520 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 161/329] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:27 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:27.686254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:27.686869 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:27.694272 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:27.694720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:27.695495 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:27.695958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:27.830026 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:27.837786 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5c7349b9-787a-477a-89ce-eda771c5d2d4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.155607 May 24 13:58:27.838356 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 169/330] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:27 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:28.500307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:28.501190 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:28.508073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:28.508489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:28.509257 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:28.509892 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:28.638716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:28.648313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e04253e2-05f1-4e85-96de-b5a45f9fcacb tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.151690 May 24 13:58:28.648900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 162/331] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:28 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:28.855418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:28.856175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:28.862681 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:28.863125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:28.863915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:28.864351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:28.997398 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:29.005172 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0cbc9213-bf96-403c-8c9c-d9b9e345cf1b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.153672 May 24 13:58:29.005741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 170/332] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:28 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:29.666014 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:29.666691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:29.672728 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:29.673175 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:29.673943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:29.674379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:29.809400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:29.816779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-384d7539-b929-407c-9346-99cb8d04e369 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.155368 May 24 13:58:29.818568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 163/333] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:29 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:30.022338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:30.022941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:30.026146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:30.031957 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:30.032402 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:30.033158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:30.033589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:30.164034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:30.171968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4a5ff6d5-2b79-41db-985b-ddbb1340ab51 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.153414 May 24 13:58:30.172532 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 171/334] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:30 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:30.834537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:30.835232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:30.841187 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:30.841631 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:30.842387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:30.842825 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:30.973273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:30.981149 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c1bfa71b-a489-47f7-a42a-1d1951488a21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.150470 May 24 13:58:30.981711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 164/335] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:30 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:31.188758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:31.189449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:31.195973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:31.196421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:31.197262 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:31.197695 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:31.332097 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:31.339691 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b8a7d610-21c4-44e8-be8c-9c678ee26faf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.154867 May 24 13:58:31.340275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 172/336] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:31 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:31.997560 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:31.998166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:32.005047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:32.005520 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:32.006289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:32.006734 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:32.141555 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:32.149434 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c15cbe9a-a076-4fd0-8b9a-cffbcc1feb21 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.155667 May 24 13:58:32.150084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 165/337] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:31 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:32.357199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:32.357748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:32.364115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:32.364557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:32.365305 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:32.365731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:32.491151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:32.500346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0310ba65-ed10-491a-a7e1-b81250d28535 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.146738 May 24 13:58:32.501477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 173/338] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:32 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:33.165786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:33.167089 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:33.173324 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:33.173767 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:33.174516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:33.174941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:33.177547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:33.313554 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:33.322003 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-667b96ca-ab4a-4666-8311-c2e7f600f9af tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.160107 May 24 13:58:33.322576 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 166/339] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:33 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:33.517880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:33.518487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:33.525812 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:33.526257 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:33.527009 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:33.527466 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:33.660188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:33.667553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-faab74a3-55ee-41a1-be24-6a2a760e0b50 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.153548 May 24 13:58:33.668133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 174/340] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:33 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:34.338253 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:34.338862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:34.344833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:34.345280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:34.346039 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:34.346471 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:34.477184 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:34.484490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e21c828c-4800-40a0-8838-877dfc9946ac tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.150079 May 24 13:58:34.485049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 167/341] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:34 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:34.683876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:34.684487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:34.690828 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:34.691275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:34.692067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:34.692504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:34.821807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:34.829060 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-23150135-3b92-499c-8c2e-9d83d14410da tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.149198 May 24 13:58:34.829629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 175/342] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:34 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:35.310817 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-b62f5253-2f8d-4b3b-bdf3-35efab7b0559 req-dd64adfd-c0cb-42b2-911b-a85bcadc7abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f11425-3efc-4ac0-88dd-449b0180843e", "name": "network-vif-unplugged", "status": "completed", "tag": "92d0feca-c6fc-482a-9c90-d85a60c51e31"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:35.322012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b62f5253-2f8d-4b3b-bdf3-35efab7b0559 req-dd64adfd-c0cb-42b2-911b-a85bcadc7abf service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:35.322520 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b62f5253-2f8d-4b3b-bdf3-35efab7b0559 req-dd64adfd-c0cb-42b2-911b-a85bcadc7abf service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:35.335874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-b62f5253-2f8d-4b3b-bdf3-35efab7b0559 req-dd64adfd-c0cb-42b2-911b-a85bcadc7abf service nova] Creating event network-vif-unplugged:92d0feca-c6fc-482a-9c90-d85a60c51e31 for instance 67f11425-3efc-4ac0-88dd-449b0180843e on hv-cinder-84212 May 24 13:58:35.352967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-b62f5253-2f8d-4b3b-bdf3-35efab7b0559 req-dd64adfd-c0cb-42b2-911b-a85bcadc7abf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034179 May 24 13:58:35.355258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 168/343] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:35.502531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:35.503279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:35.510334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:35.510794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:35.511577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:35.512067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:35.782099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-7033eb4a-1009-4392-a4e6-db0e5519e43c req-65118acd-2a0e-45b3-b0cc-bbef1eb5a7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f11425-3efc-4ac0-88dd-449b0180843e", "name": "network-vif-deleted", "tag": "92d0feca-c6fc-482a-9c90-d85a60c51e31"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:35.783842 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:35.791307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-7033eb4a-1009-4392-a4e6-db0e5519e43c req-65118acd-2a0e-45b3-b0cc-bbef1eb5a7bf service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:35.791749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-7033eb4a-1009-4392-a4e6-db0e5519e43c req-65118acd-2a0e-45b3-b0cc-bbef1eb5a7bf service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:35.792085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-27be5ccc-a5e2-43e5-84a0-2cd6106c38bf tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1503 microversion: 2.1 time: 0.293784 May 24 13:58:35.792731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 176/344] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:35 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:35.802367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-7033eb4a-1009-4392-a4e6-db0e5519e43c req-65118acd-2a0e-45b3-b0cc-bbef1eb5a7bf service nova] Creating event network-vif-deleted:92d0feca-c6fc-482a-9c90-d85a60c51e31 for instance 67f11425-3efc-4ac0-88dd-449b0180843e on hv-cinder-84212 May 24 13:58:35.807348 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-7033eb4a-1009-4392-a4e6-db0e5519e43c req-65118acd-2a0e-45b3-b0cc-bbef1eb5a7bf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029295 May 24 13:58:35.807942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 169/345] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 13:58:35.846375 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:35.847016 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:35.852968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:35.853418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:35.854186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:35.854632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:35.991683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:35.999178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-20d022e2-ffab-4e1b-8c89-d9bdbdfa3fb8 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1371 microversion: 2.1 time: 0.156515 May 24 13:58:35.999767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 177/346] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:35 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:36.810375 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:36.811124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:36.813112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=62 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:36.820897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:36.821351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:36.822413 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:36.822787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:36.863275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:36.863711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:36.864301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lazy-loading 'fault' on Instance uuid 67f11425-3efc-4ac0-88dd-449b0180843e {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 13:58:37.017092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:37.017760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:37.024976 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:37.025407 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:37.026246 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:37.026677 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:37.088196 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:37.101693 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-68df5b23-1aea-49cd-9339-5844974532ee tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 200 len: 1303 microversion: 2.1 time: 0.295408 May 24 13:58:37.102488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 170/347] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:36 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 1303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:37.175477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:37.184114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8029705c-8c04-4400-9d29-20d8857143dd tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1566 microversion: 2.1 time: 0.171108 May 24 13:58:37.184683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 178/348] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:37 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:37.201375 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:37.202015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:37.208129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:37.208656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:37.209493 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:37.210078 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:37.289119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-992b3ae6-91ed-4c00-b5c2-3d673cf9d040 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091337 May 24 13:58:37.289756 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 171/349] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 13:58:37 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:38.119231 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:38.119869 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 67f11425-3efc-4ac0-88dd-449b0180843e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:38.127620 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:38.128277 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:38.129061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:38.129885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:38.144529 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] HTTP exception thrown: Instance 67f11425-3efc-4ac0-88dd-449b0180843e could not be found. May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Request method failure captured: May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e HTTP/1.1 May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijORXGbXLjaB5eLz_XxBsXXXpxGZ0tVRQCeVPZM7hPYX1637Krj3oNzCSzl032xin6Xf9WZUVOOCKdJXvfdrcGaVIZPyZJdNQowNBcvAqdO-JLxL4UbgCCEq9_qqZ8tspBGr3sqJFJfYNuZUU85A1pMakj58unoLGQGBjqhRfh7Eh0aQ May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: b8708171d18747eda57bed0a3cb3030b May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesActionsTest-1230257014 May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 13:58:38.146189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesActionsTest-1230257014 May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: b8708171d18747eda57bed0a3cb3030b May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesActionsTest-1230257014 May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesActionsTest-1230257014-project May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: ca15829f779b403d8a78940b17dccf6a May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesActionsTest-1230257014-project May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 67f11425-3efc-4ac0-88dd-449b0180843e could not be found. May 24 13:58:38.147765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '67f11425-3efc-4ac0-88dd-449b0180843e'} May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f11425-3efc-4ac0-88dd-449b0180843e could not be found. May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:58:38.149449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f11425-3efc-4ac0-88dd-449b0180843e could not be found. May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f11425-3efc-4ac0-88dd-449b0180843e could not be found. May 24 13:58:38.151247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 13:58:38.152581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Returning 404 to user: Instance 67f11425-3efc-4ac0-88dd-449b0180843e could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:58:38.152581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5a58ebc9-a2e0-42a5-b325-64a70e6b8bb5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e" status: 404 len: 111 microversion: 2.1 time: 0.033116 May 24 13:58:38.153227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 179/350] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:38 2022] GET /compute/v2.1/servers/67f11425-3efc-4ac0-88dd-449b0180843e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:58:38.272352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1082939390", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "networks": [{"uuid": "f063f9ef-2098-4bf4-a44f-09110a7a9fdf"}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:38.333007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] validate_networks() for [('f063f9ef-2098-4bf4-a44f-09110a7a9fdf', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:58:38.680186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-47ca99c6-2a9e-4981-8041-136a52a51835 req-c61e5e96-9de2-42ee-bd69-9056296bd605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efba3b6-0b80-48c5-ac89-0db944e2ac8f", "tag": "6ec58c80-6380-4300-8c4d-013be3a1d9bb"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:38.690065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-47ca99c6-2a9e-4981-8041-136a52a51835 req-c61e5e96-9de2-42ee-bd69-9056296bd605 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:38.691322 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-47ca99c6-2a9e-4981-8041-136a52a51835 req-c61e5e96-9de2-42ee-bd69-9056296bd605 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:38.705898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-47ca99c6-2a9e-4981-8041-136a52a51835 req-c61e5e96-9de2-42ee-bd69-9056296bd605 service nova] Creating event network-changed:6ec58c80-6380-4300-8c4d-013be3a1d9bb for instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f on hv-cinder-84212 May 24 13:58:38.720463 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-47ca99c6-2a9e-4981-8041-136a52a51835 req-c61e5e96-9de2-42ee-bd69-9056296bd605 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046158 May 24 13:58:38.722321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 180/351] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:39.004415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:58:39.004831 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:58:39.005321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:58:39.005726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:58:39.006148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:58:39.015271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:39.015716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:39.016580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:39.017257 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:39.039318 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Getting quotas for project b8708171d18747eda57bed0a3cb3030b. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:58:39.045690 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Getting quotas for user ca15829f779b403d8a78940b17dccf6a and project b8708171d18747eda57bed0a3cb3030b. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:58:39.058276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:58:39.060566 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:58:39.110543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-db9af274-c3eb-44d2-a870-3489f149efed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844215 May 24 13:58:39.111668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 172/352] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 13:58:39.127399 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-31deab11-ee63-44bf-84f0-c80f0a5c8f17 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:39.129745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-31deab11-ee63-44bf-84f0-c80f0a5c8f17 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:39.238177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-31deab11-ee63-44bf-84f0-c80f0a5c8f17 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:39.252798 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-31deab11-ee63-44bf-84f0-c80f0a5c8f17 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1214 microversion: 2.1 time: 0.131771 May 24 13:58:39.253274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 181/353] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:39 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:40.269064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:40.269678 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:40.277037 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:40.277418 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:40.278176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:40.278605 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:40.345278 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:40.352781 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c774813c-ef9e-41be-92ee-16158ab1852a tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1266 microversion: 2.1 time: 0.087876 May 24 13:58:40.353352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 173/354] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:40 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:40.922745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1622876137", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-131305348", "security_groups": [{"name": "tempest-secgroup-smoke-281582916"}], "block_device_mapping_v2": [{"uuid": "e1e4dc8d-78c4-4084-b008-f8510a2cd10f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da184706-a3cd-4a03-bf62-0c961d1fd5b4"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:41.077941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] validate_networks() for [('da184706-a3cd-4a03-bf62-0c961d1fd5b4', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 13:58:41.370267 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:41.370881 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:41.377612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:41.378300 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:41.379305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:41.379768 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:41.500776 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 13:58:41.501194 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 13:58:41.507227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 13:58:41.507811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 13:58:41.508521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 13:58:41.517325 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:41.517774 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:41.518611 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:41.519046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:41.540868 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 13:58:41.544918 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for user 3acb774848a74e74a5886ee681ed205c and project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 13:58:41.605710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:41.608592 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 13:58:41.610973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1e4dc8d-78c4-4084-b008-f8510a2cd10f',volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 13:58:41.613162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bc1c8a7d-1214-4ea8-8882-6bf51d9b09d7 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.247354 May 24 13:58:41.613736 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 174/355] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:41 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:41.774165 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8d8c6b71-ddef-440c-ad75-3c7011b6e754 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.857249 May 24 13:58:41.774712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 182/356] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 13:58:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 13:58:41.784991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b0d5e0c4-934c-49e8-b464-825a151f5aa2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:41.785902 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b0d5e0c4-934c-49e8-b464-825a151f5aa2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:41.852845 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b0d5e0c4-934c-49e8-b464-825a151f5aa2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:41.862034 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b0d5e0c4-934c-49e8-b464-825a151f5aa2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1094 microversion: 2.1 time: 0.080859 May 24 13:58:41.862623 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 175/357] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:41 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:42.221992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-6f2259c4-2418-47cd-9a3e-1c764fde97bd req-bff5be12-c282-4f89-a121-a94ee864fd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942d61a2-7577-4bad-904a-01e33811c4f3", "tag": "d83a6ec4-20d8-44e5-aa40-6a4b83497a6f"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:42.234095 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-6f2259c4-2418-47cd-9a3e-1c764fde97bd req-bff5be12-c282-4f89-a121-a94ee864fd58 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:42.235618 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-6f2259c4-2418-47cd-9a3e-1c764fde97bd req-bff5be12-c282-4f89-a121-a94ee864fd58 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:42.251048 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-6f2259c4-2418-47cd-9a3e-1c764fde97bd req-bff5be12-c282-4f89-a121-a94ee864fd58 service nova] Creating event network-changed:d83a6ec4-20d8-44e5-aa40-6a4b83497a6f for instance 942d61a2-7577-4bad-904a-01e33811c4f3 on hv-cinder-84212 May 24 13:58:42.256147 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-6f2259c4-2418-47cd-9a3e-1c764fde97bd req-bff5be12-c282-4f89-a121-a94ee864fd58 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038503 May 24 13:58:42.256746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 183/358] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:42.630814 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:42.631417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:42.638156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:42.638545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:42.639325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:42.639755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:42.858174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:42.867920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bc9dd4e2-38ca-4ded-bff6-4b65cca46da2 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.240973 May 24 13:58:42.869166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 176/359] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:42 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:42.881476 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:42.883675 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:42.892116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:42.893015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:42.894709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:42.895316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:42.920488 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:42.983946 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:43.003519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-49f1663d-27a9-4f92-bf42-4b7bdb2393e7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1210 microversion: 2.1 time: 0.121969 May 24 13:58:43.004773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 184/360] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:42 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:43.891897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:43.891897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:43.895024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:43.895617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:43.896504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:43.897013 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:44.021633 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:44.022250 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:44.027852 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:44.029046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:44.029499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:44.030274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:44.030712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:44.035042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2b653dcc-fa68-4baa-ae7c-bca6e811ccf5 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.151971 May 24 13:58:44.035610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 177/361] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:43 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:44.091532 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:44.098915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-33153c99-db24-45c3-bbff-0b13cae2a964 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1210 microversion: 2.1 time: 0.081110 May 24 13:58:44.099473 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 185/362] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:44 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:45.052433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:45.053035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:45.059941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:45.060385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:45.061135 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:45.061570 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:45.116906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:45.118162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:45.124773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:45.125470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:45.126249 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:45.126721 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:45.189336 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:45.192878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:45.198408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bb3f7318-a293-40d1-bbd5-771a6b1c254d tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.149777 May 24 13:58:45.198990 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 178/363] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:45 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:45.202023 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b5dde561-5f91-4039-b4a6-81bc863dab13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1210 microversion: 2.1 time: 0.089608 May 24 13:58:45.202583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 186/364] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:45 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:46.214627 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:46.215182 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:46.218440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:46.219046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:46.221223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:46.221666 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:46.222421 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:46.222844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:46.225358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:46.226344 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:46.227400 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:46.228156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:46.290160 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:46.297418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d89db236-82f3-42cd-a657-c15eab923035 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1210 microversion: 2.1 time: 0.083080 May 24 13:58:46.297984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 187/365] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:46 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:46.354038 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:46.361379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1003123b-5ee2-4e2f-9bab-895c161ec17b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.150685 May 24 13:58:46.361941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 179/366] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:46 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:47.314443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:47.315022 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:47.324156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:47.324649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:47.325532 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:47.325971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:47.378821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:47.379429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:47.386426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:47.386877 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:47.387306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:47.387643 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:47.388114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:47.395634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d374911-96d8-4dac-a913-31f39e6850af tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1210 microversion: 2.1 time: 0.085170 May 24 13:58:47.396219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 188/367] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:47 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:47.513541 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:47.520972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-011533f9-0aa8-49ee-8ab3-bb215f76c0ab tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.146276 May 24 13:58:47.521537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 180/368] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:47 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:48.412679 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:48.413333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:48.419884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:48.420341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:48.421106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:48.421547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:48.481487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:48.489114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-341d2b1e-c8ec-48ee-a366-ff7a0cdf985c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1210 microversion: 2.1 time: 0.080281 May 24 13:58:48.490020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 189/369] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:48 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:48.538243 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:48.539295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:48.546363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:48.547659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:48.548756 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:48.549214 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:48.747990 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:48.755859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-96131ab1-0f97-46e4-9621-14d9ccd730db tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.222094 May 24 13:58:48.756424 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 181/370] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:48 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:49.510018 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:49.510678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:49.522829 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:49.523339 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:49.524175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:49.524598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:49.755411 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:49.763602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fde3bfe8-d423-436e-988f-b852e7c1d900 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.261077 May 24 13:58:49.764222 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 190/371] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:49 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:49.770197 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:49.777746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:49.778364 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:49.786450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:49.786917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:49.789218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:49.791046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:49.838095 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-b3ea1bcd-c715-40ab-a008-c8779eca26b7 req-0410b2e7-d25e-475d-b189-a1d3d253ac22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975be349-7e4e-4048-b0e1-471723fa08a0", "tag": "446094fa-479e-4763-a75c-d6f1bca52a15"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:49.850020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-b3ea1bcd-c715-40ab-a008-c8779eca26b7 req-0410b2e7-d25e-475d-b189-a1d3d253ac22 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:49.850509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-b3ea1bcd-c715-40ab-a008-c8779eca26b7 req-0410b2e7-d25e-475d-b189-a1d3d253ac22 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:49.885197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-b3ea1bcd-c715-40ab-a008-c8779eca26b7 req-0410b2e7-d25e-475d-b189-a1d3d253ac22 service nova] Creating event network-changed:446094fa-479e-4763-a75c-d6f1bca52a15 for instance 975be349-7e4e-4048-b0e1-471723fa08a0 on hv-cinder-84212 May 24 13:58:49.891321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-b3ea1bcd-c715-40ab-a008-c8779eca26b7 req-0410b2e7-d25e-475d-b189-a1d3d253ac22 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059687 May 24 13:58:49.892518 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 191/372] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:49.952765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:49.960964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bd8ce724-f29e-4916-baef-2679afa02ea8 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.191301 May 24 13:58:49.962155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 182/373] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:49 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:50.781940 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:50.782662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:50.788893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:50.789373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:50.790130 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:50.790583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:50.919328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:50.926636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-21aa2916-4d43-44e4-b67b-387b6eed9cc9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.149363 May 24 13:58:50.927197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 192/374] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:50 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:50.977323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:50.977928 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:50.983873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:50.984315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:50.985067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:50.985494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:51.114719 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:51.122638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-abc8a67b-a131-4d84-80e3-56ed421bb237 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.149643 May 24 13:58:51.123200 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 183/375] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:50 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 13:58:51.937204 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-58df3428-41f1-47d2-900e-5c638d43edf4 req-6e0d12b6-6e50-4de0-ac9e-8826fbd6eb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942d61a2-7577-4bad-904a-01e33811c4f3", "name": "network-vif-plugged", "status": "completed", "tag": "d83a6ec4-20d8-44e5-aa40-6a4b83497a6f"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:51.941249 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:51.942143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=8 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:51.943128 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:51.943972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:51.947979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=8 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:51.953333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-58df3428-41f1-47d2-900e-5c638d43edf4 req-6e0d12b6-6e50-4de0-ac9e-8826fbd6eb69 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:51.953333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-58df3428-41f1-47d2-900e-5c638d43edf4 req-6e0d12b6-6e50-4de0-ac9e-8826fbd6eb69 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:51.955037 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:51.956447 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:51.957741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:51.958191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:51.968522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-58df3428-41f1-47d2-900e-5c638d43edf4 req-6e0d12b6-6e50-4de0-ac9e-8826fbd6eb69 service nova] Creating event network-vif-plugged:d83a6ec4-20d8-44e5-aa40-6a4b83497a6f for instance 942d61a2-7577-4bad-904a-01e33811c4f3 on hv-cinder-84212 May 24 13:58:51.973420 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-58df3428-41f1-47d2-900e-5c638d43edf4 req-6e0d12b6-6e50-4de0-ac9e-8826fbd6eb69 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039912 May 24 13:58:51.974349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 193/376] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:52.102866 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:52.111508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9c5a43cc-5b52-4599-86be-d28e8b0d80f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.172447 May 24 13:58:52.112307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 184/377] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:51 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:52.141071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:52.141958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:52.149737 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:52.150421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:52.151333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:52.151778 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:52.376322 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:52.384233 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e58ac6c8-c0a7-421d-b2ee-8825fabef1bc tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.248253 May 24 13:58:52.384802 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 194/378] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:52 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:53.129711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:53.130323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:53.137498 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:53.137925 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:53.138681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:53.139119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:53.279308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:53.281531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:58:53.287872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7c43258c-04bc-4c5d-b4ec-03edb5d19f84 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.162573 May 24 13:58:53.288442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 185/379] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:53 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:53.400950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:53.401554 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:53.407962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:53.408400 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:53.409151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:53.409612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:53.541328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:53.548705 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9e4d7a6c-6e07-40f4-9148-ed796773b48b tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1314 microversion: 2.1 time: 0.151830 May 24 13:58:53.549275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 195/380] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:53 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:54.305511 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:54.306125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:54.312326 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:54.312773 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:54.313535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:54.313963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:54.452930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:54.460547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a9c4635e-e82d-4b87-9c80-b8ebc6d44e33 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.159694 May 24 13:58:54.461334 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 186/381] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:54 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:54.566095 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:54.566642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:54.573322 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:54.573783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:54.574550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:54.574990 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:54.703451 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:54.710939 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7ff03bfa-824d-4249-a372-235be6267458 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1498 microversion: 2.1 time: 0.148783 May 24 13:58:54.711511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 196/382] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:54 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:55.143918 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:55.144420 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:55.151197 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:55.151697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:55.152528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:55.152959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:55.177275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 13:58:55.253566 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e3a37fd1-f899-4d83-9375-9ce73efa6009 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "DELETE /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 204 len: 0 microversion: 2.1 time: 0.113268 May 24 13:58:55.254430 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 187/383] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 13:58:55 2022] DELETE /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 13:58:55.263334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:55.264049 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:55.271133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:55.271583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:55.272399 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:55.273791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:55.403931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:55.411198 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-009a0bec-f725-4c54-ac08-0499f2224092 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1504 microversion: 2.1 time: 0.151727 May 24 13:58:55.411760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 197/384] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:55 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:55.478252 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:55.478948 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:55.484861 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:55.485307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:55.486067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:55.486499 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:55.614739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:55.622998 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ea7af000-e157-4be2-afe5-38549a4ab7dc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.149169 May 24 13:58:55.623567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 188/385] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:55 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:56.428436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:56.429251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:56.435940 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:56.436481 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:56.437327 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:56.437827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:56.600614 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:56.610201 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-829a91a8-b4fa-46e2-9075-73965107d064 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1504 microversion: 2.1 time: 0.185629 May 24 13:58:56.610786 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 198/386] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:56 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:56.640385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:56.641000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:56.646880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:56.647328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:56.648873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:56.649319 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:56.784354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:56.793554 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-add93382-119c-46c5-b4af-f78a48ca5839 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.156997 May 24 13:58:56.794146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 189/387] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:56 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:57.402470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-5f301e7b-827a-4c18-b3b7-bb82d0a93fdf req-360aed04-0ed1-48b0-9439-ce15d5f32f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942d61a2-7577-4bad-904a-01e33811c4f3", "name": "network-vif-deleted", "tag": "d83a6ec4-20d8-44e5-aa40-6a4b83497a6f"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:58:57.410555 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5f301e7b-827a-4c18-b3b7-bb82d0a93fdf req-360aed04-0ed1-48b0-9439-ce15d5f32f91 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:57.411007 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5f301e7b-827a-4c18-b3b7-bb82d0a93fdf req-360aed04-0ed1-48b0-9439-ce15d5f32f91 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:57.422189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-5f301e7b-827a-4c18-b3b7-bb82d0a93fdf req-360aed04-0ed1-48b0-9439-ce15d5f32f91 service nova] Creating event network-vif-deleted:d83a6ec4-20d8-44e5-aa40-6a4b83497a6f for instance 942d61a2-7577-4bad-904a-01e33811c4f3 on hv-cinder-84212 May 24 13:58:57.426970 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-5f301e7b-827a-4c18-b3b7-bb82d0a93fdf req-360aed04-0ed1-48b0-9439-ce15d5f32f91 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028201 May 24 13:58:57.427462 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 199/388] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:58:57.630123 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:57.630933 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:57.637514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:57.637962 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:57.638723 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:57.639155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:57.704027 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:57.711965 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bab8c783-9975-47f5-80b7-4bed9b794254 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1462 microversion: 2.1 time: 0.085628 May 24 13:58:57.712755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 190/389] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:57 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:57.811468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:57.812199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:57.824922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:57.825507 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:57.826264 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:57.826700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:57.967786 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:57.975215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c40926ab-ae9c-4c45-8e65-898b9f140664 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.168403 May 24 13:58:57.976536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 200/390] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:57 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:58.728955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:58.729592 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:58.735609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:58.736096 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:58.736854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:58.737288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:58.800640 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca15829f779b403d8a78940b17dccf6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8708171d18747eda57bed0a3cb3030b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:58.808560 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d435ae83-b851-4c6a-acc7-53f10b0144ed tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 200 len: 1462 microversion: 2.1 time: 0.083600 May 24 13:58:58.809124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 191/391] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:58 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:58.992990 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:58.993631 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:59.000327 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:59.000782 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:59.001551 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:59.001991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:59.157394 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:58:59.165913 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-396f772e-418e-4b77-9ac6-a4eba3dc7576 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.177642 May 24 13:58:59.166653 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 201/392] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:58 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:58:59.826025 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:58:59.826625 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] [instance: 942d61a2-7577-4bad-904a-01e33811c4f3] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:58:59.833363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:59.833806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:59.834561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:58:59.837475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:58:59.851658 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] HTTP exception thrown: Instance 942d61a2-7577-4bad-904a-01e33811c4f3 could not be found. May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Request method failure captured: May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 HTTP/1.1 May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijORXGbXLjaB5eLz_XxBsXXXpxGZ0tVRQCeVPZM7hPYX1637Krj3oNzCSzl032xin6Xf9WZUVOOCKdJXvfdrcGaVIZPyZJdNQowNBcvAqdO-JLxL4UbgCCEq9_qqZ8tspBGr3sqJFJfYNuZUU85A1pMakj58unoLGQGBjqhRfh7Eh0aQ May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: b8708171d18747eda57bed0a3cb3030b May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesActionsTest-1230257014 May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 13:58:59.853362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b8708171d18747eda57bed0a3cb3030b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesActionsTest-1230257014 May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: b8708171d18747eda57bed0a3cb3030b May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesActionsTest-1230257014 May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesActionsTest-1230257014-project May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: ca15829f779b403d8a78940b17dccf6a May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesActionsTest-1230257014-project May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 942d61a2-7577-4bad-904a-01e33811c4f3 could not be found. May 24 13:58:59.854860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '942d61a2-7577-4bad-904a-01e33811c4f3'} May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942d61a2-7577-4bad-904a-01e33811c4f3 could not be found. May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 13:58:59.860730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942d61a2-7577-4bad-904a-01e33811c4f3 could not be found. May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942d61a2-7577-4bad-904a-01e33811c4f3 could not be found. May 24 13:58:59.861895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 13:58:59.863727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] Returning 404 to user: Instance 942d61a2-7577-4bad-904a-01e33811c4f3 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 13:58:59.863727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0524e809-d64e-44b8-8024-eccd2de3c981 tempest-VolumesActionsTest-1230257014 tempest-VolumesActionsTest-1230257014-project] 10.222.0.24 "GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3" status: 404 len: 111 microversion: 2.1 time: 0.032671 May 24 13:58:59.863727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 192/393] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:58:59 2022] GET /compute/v2.1/servers/942d61a2-7577-4bad-904a-01e33811c4f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 13:59:00.184098 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:00.184710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:00.188465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:00.195724 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:00.196467 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:00.197399 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:00.197931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:00.342947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:00.351203 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4cdaba46-98cb-4078-bfb0-402b2031b17d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.170573 May 24 13:59:00.351772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 202/394] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:00 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:01.368269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:01.368880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:01.375335 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:01.375788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:01.376614 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:01.377057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:01.507662 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:01.515214 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e47602da-699e-4d50-8b45-14e523f1a4b6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.151418 May 24 13:59:01.515777 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 193/395] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:01 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:02.532359 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:02.532965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:02.539481 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:02.539955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:02.540708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:02.541141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:02.545039 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:02.672745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:02.680829 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d1fda0a3-8bb7-4e56-957b-fd23b4ee7da0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.152295 May 24 13:59:02.681392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 203/396] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:02 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:03.697758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:03.698374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:03.704395 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:03.704841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:03.705596 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:03.706027 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:03.839850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:03.847676 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-eb85064d-9c52-4ffa-8ded-caa5299ff3c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.154191 May 24 13:59:03.848280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 194/397] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:03 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:04.084320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 13:59:04.084528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 13:59:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 13:59:04.864684 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:04.865228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:04.871778 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:04.872257 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:04.873019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:04.873455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:05.010994 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:05.018367 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d65ff9fd-f59e-46a6-ae50-74a95145c85e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.157657 May 24 13:59:05.018927 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 204/398] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:04 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:06.036248 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:06.036839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:06.043012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:06.043461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:06.044247 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:06.044682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:06.171637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:06.179689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c20de7cd-b636-4c0c-a57d-01cd6b33b068 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.147320 May 24 13:59:06.180289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 195/399] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:06 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:07.197002 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:07.197617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:07.204138 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:07.204590 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:07.205348 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:07.205786 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:07.341492 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:07.348990 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-afc0cbd7-d02e-472f-a3c7-de01242251c5 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.156392 May 24 13:59:07.349561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 205/400] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:07 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:08.366103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:08.367005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:08.368612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:08.373942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:08.374387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:08.375400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:08.375848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:08.504419 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:08.511746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-694a2cd1-1a04-40d7-bae2-befd01d877e4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.149514 May 24 13:59:08.512341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 196/401] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:08 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:09.528444 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:09.529228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:09.536478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:09.536927 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:09.538235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:09.538685 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:09.679073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:09.686559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4ca84836-c97f-4999-a486-14cabc5b0ad4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.162066 May 24 13:59:09.687129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 206/402] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:09 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:09.723411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-574a2192-d66d-459b-bc28-4fc4321274ea req-73c68b4f-050d-4b6a-b3f1-ce1a4682dfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975be349-7e4e-4048-b0e1-471723fa08a0", "name": "network-vif-plugged", "status": "completed", "tag": "446094fa-479e-4763-a75c-d6f1bca52a15"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:59:09.732007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-574a2192-d66d-459b-bc28-4fc4321274ea req-73c68b4f-050d-4b6a-b3f1-ce1a4682dfa4 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:09.732449 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-574a2192-d66d-459b-bc28-4fc4321274ea req-73c68b4f-050d-4b6a-b3f1-ce1a4682dfa4 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:09.745617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-574a2192-d66d-459b-bc28-4fc4321274ea req-73c68b4f-050d-4b6a-b3f1-ce1a4682dfa4 service nova] Creating event network-vif-plugged:446094fa-479e-4763-a75c-d6f1bca52a15 for instance 975be349-7e4e-4048-b0e1-471723fa08a0 on hv-cinder-84212 May 24 13:59:09.750984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-574a2192-d66d-459b-bc28-4fc4321274ea req-73c68b4f-050d-4b6a-b3f1-ce1a4682dfa4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031343 May 24 13:59:09.751579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 197/403] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:59:10.703901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:10.704514 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:10.711474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:10.711951 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:10.712715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:10.713151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:10.848712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:10.856763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-62af6e58-a754-42e2-b6a4-6ff88c21892f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.156746 May 24 13:59:10.857328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 207/404] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:10 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:11.874042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:11.874995 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:11.881180 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:11.881633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:11.882392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:11.882829 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:12.013558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:12.020867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6e0fe51a-3e01-43d2-b16f-0b9fb199c007 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.151148 May 24 13:59:12.021428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 198/405] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:11 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:13.038462 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:13.039093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:13.045796 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:13.046273 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:13.047038 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:13.047474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:13.175455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:13.183519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-74d8eb29-f136-48e2-bcc1-a0fffb6068d9 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.149206 May 24 13:59:13.184123 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 208/406] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:13 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:14.200897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:14.201426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:14.207446 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:14.207912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:14.208663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:14.210229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:14.341036 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:14.348456 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7c89e5b7-b65a-490b-83f2-c9b4474d1b13 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.151472 May 24 13:59:14.349021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 199/407] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:14 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:15.365791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:15.366390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:15.373077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:15.373522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:15.374281 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:15.374962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:15.503493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:15.511553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f1753b7b-0144-4349-8c27-dd02c05dcc75 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.149806 May 24 13:59:15.512144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 209/408] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:15 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:16.529164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:16.529766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:16.535761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:16.536230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:16.536979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:16.538200 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:16.667399 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:16.674811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a7390973-af45-4424-aca0-310f5774958c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1265 microversion: 2.1 time: 0.149554 May 24 13:59:16.675370 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 200/409] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:16 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:17.691756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:17.692531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:17.700071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:17.700729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:17.701958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:17.702410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:17.845691 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:17.854633 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-da25790b-a2b5-40b6-9e69-055f083d6509 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1452 microversion: 2.1 time: 0.166907 May 24 13:59:17.855477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 210/410] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:17 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:17.875411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:17.876569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:17.883872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:17.884588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:17.885778 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:17.886426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:18.029789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 13:59:18.038028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-272e093e-3943-4065-b08e-146875555de6 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1452 microversion: 2.1 time: 0.169051 May 24 13:59:18.038524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 201/411] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 13:59:17 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 13:59:20.546086 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-e5a8b7b1-a195-40f7-8f0b-5d5f7aeee233 req-f3bcdb86-abb5-4d9d-97b2-3565eec2ef1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975be349-7e4e-4048-b0e1-471723fa08a0", "tag": "446094fa-479e-4763-a75c-d6f1bca52a15"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:59:20.561078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-e5a8b7b1-a195-40f7-8f0b-5d5f7aeee233 req-f3bcdb86-abb5-4d9d-97b2-3565eec2ef1b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:20.561825 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-e5a8b7b1-a195-40f7-8f0b-5d5f7aeee233 req-f3bcdb86-abb5-4d9d-97b2-3565eec2ef1b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:20.574286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-e5a8b7b1-a195-40f7-8f0b-5d5f7aeee233 req-f3bcdb86-abb5-4d9d-97b2-3565eec2ef1b service nova] Creating event network-changed:446094fa-479e-4763-a75c-d6f1bca52a15 for instance 975be349-7e4e-4048-b0e1-471723fa08a0 on hv-cinder-84212 May 24 13:59:20.579734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-e5a8b7b1-a195-40f7-8f0b-5d5f7aeee233 req-f3bcdb86-abb5-4d9d-97b2-3565eec2ef1b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037251 May 24 13:59:20.581663 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 211/412] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 13:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:59:57.399895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 13:59:57.400406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:57.402582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=11 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:57.403281 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:57.409230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:57.409680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:57.410448 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:57.410891 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:57.434903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-085ebd66-95da-4698-85dc-949ae6da73dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/ips" status: 200 len: 150 microversion: 2.1 time: 0.039810 May 24 13:59:57.435466 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 202/413] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 13:59:57 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 13:59:58.771323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=19 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:58.772571 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=48 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 13:59:58.777268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d11144b6-a1df-4f35-a775-19c3cfded00c"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 13:59:58.778394 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 13:59:58.785248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:58.785693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:58.786440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 13:59:58.786868 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 13:59:59.024247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-826fb33d-7b0f-4824-b881-f25e73fbaba6 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254252 May 24 13:59:59.025058 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 212/414] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 13:59:58 2022] POST /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:00:06.510316 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-53de2005-43b0-45d3-b763-173e89bb33dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: .version_select at 0x7f33b5942550>, body: {"keypair": {"name": "tempest-keypair-1700931574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrbrL/VjcphAtxSE0lI/W4qJ68hZ9L92Y6R4HHjgVvaxW4nexzk+Ap/lE+49CJdz+2An47i0byximGbcqpiTG6RWiJ9ovEdBy+GgkqI8HRnUgAuafzia4W7/SA8n3n8yg=="}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:06.524804 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-53de2005-43b0-45d3-b763-173e89bb33dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:00:06.528594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-53de2005-43b0-45d3-b763-173e89bb33dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:00:06.553207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-53de2005-43b0-45d3-b763-173e89bb33dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046653 May 24 14:00:06.553794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 203/415] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:00:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:00:07.816331 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1395852179", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e5782d9-5791-4763-85b4-bfd8289d9060"}], "security_groups": [{"name": "tempest-securitygroup--1272196608"}], "key_name": "tempest-keypair-1700931574", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:07.922446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] validate_networks() for [('2e5782d9-5791-4763-85b4-bfd8289d9060', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:00:08.275079 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:00:08.275503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:00:08.276027 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:00:08.276438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:00:08.276898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:00:08.285927 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:08.286372 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:08.287973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:08.288412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:08.304979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:00:08.308799 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:00:08.319431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:00:08.321762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:00:08.370284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ecee38cb-9d03-4247-ad5d-5bb801cdb136 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558659 May 24 14:00:08.370853 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 213/416] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:00:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:00:08.377975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=4 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:08.382139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0a368414-c3ed-4cc5-b62a-ba19624af2c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:08.382746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0a368414-c3ed-4cc5-b62a-ba19624af2c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:08.436353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0a368414-c3ed-4cc5-b62a-ba19624af2c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:08.443039 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0a368414-c3ed-4cc5-b62a-ba19624af2c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1242 microversion: 2.1 time: 0.065758 May 24 14:00:08.443614 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 204/417] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:08 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:09.462188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:09.462804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:09.469791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:09.470253 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:09.471017 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:09.471455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:09.534019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:09.541756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-da972c1c-340f-488b-94af-3473683b2292 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1300 microversion: 2.1 time: 0.085706 May 24 14:00:09.542329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 214/418] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:09 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:10.558626 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:10.559242 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:10.566696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:10.567141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:10.568098 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:10.568712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:10.711542 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:10.719037 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-90382460-70d0-46b5-9d02-d907ee817a28 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.164235 May 24 14:00:10.719615 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 205/419] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:10 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:10.743128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-9a28526f-b20c-4d07-b6d4-66750809313e req-37b5a750-6c7a-44b1-b1f1-2e483d9007f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840693fa-71a3-4a35-8979-596bfcc1aa86", "tag": "7c101693-d68b-41a9-ac5b-61fc73b8be1d"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:10.753045 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9a28526f-b20c-4d07-b6d4-66750809313e req-37b5a750-6c7a-44b1-b1f1-2e483d9007f2 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:10.753706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9a28526f-b20c-4d07-b6d4-66750809313e req-37b5a750-6c7a-44b1-b1f1-2e483d9007f2 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:10.765809 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-9a28526f-b20c-4d07-b6d4-66750809313e req-37b5a750-6c7a-44b1-b1f1-2e483d9007f2 service nova] Creating event network-changed:7c101693-d68b-41a9-ac5b-61fc73b8be1d for instance 840693fa-71a3-4a35-8979-596bfcc1aa86 on hv-cinder-84212 May 24 14:00:10.776985 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-9a28526f-b20c-4d07-b6d4-66750809313e req-37b5a750-6c7a-44b1-b1f1-2e483d9007f2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040303 May 24 14:00:10.778274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 215/420] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:00:11.735578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:11.736218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:11.743059 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:11.743511 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:11.744313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:11.744754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:11.869718 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:11.877552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5b74ce40-96bd-4055-9567-904f68c103d3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.145617 May 24 14:00:11.878444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 206/421] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:11 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:12.896020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:12.896623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:12.902900 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:12.903350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:12.904142 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:12.904578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:13.042629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:13.050103 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d40fa0d-9237-4574-aea0-76406c5dacb1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.159210 May 24 14:00:13.050700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 216/422] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:12 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:13.086978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:13.087494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:13.093404 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:13.093848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:13.094595 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:13.095027 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:13.118847 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7d769673-b897-456e-9511-8f511302bc5e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/ips" status: 200 len: 150 microversion: 2.20 time: 0.035955 May 24 14:00:13.119406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 207/423] 10.222.0.24 () {60 vars in 1288 bytes} [Tue May 24 14:00:13 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 14:00:14.068008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:14.068549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:14.074904 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:14.075349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:14.076126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:14.076559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:14.207670 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:14.215062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9c725f0c-d198-4592-9518-2a1f6c34454e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.151634 May 24 14:00:14.215626 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 217/424] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:14 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:14.935188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:14.935786 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:14.941610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:14.942058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:14.942942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:14.943374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:14.967048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lazy-loading 'flavor' on Instance uuid 7359d8e4-b8a7-4219-903d-71ea9f7a9292 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:00:15.231439 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:15.232085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:15.239596 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:15.239947 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a47e3bd0-1b62-45eb-a26e-95835fbf836d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/action" status: 202 len: 0 microversion: 2.20 time: 0.308192 May 24 14:00:15.240497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:15.243893 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 208/425] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 24 14:00:14 2022] POST /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 14:00:15.244033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:15.244033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:15.249980 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:15.250776 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:15.257434 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:15.258146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:15.258842 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:15.259436 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:15.397825 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:15.405096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f97d2141-411f-4ecd-83d3-ec14eaad8ec1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.177454 May 24 14:00:15.405662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 218/426] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:15 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:00:15.426015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:15.434079 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:15.435617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:15.436801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-36d92703-209b-4f62-b11c-8f428f32df10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.191635 May 24 14:00:15.437398 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 209/427] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:15 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:16.421897 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:16.422424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:16.429451 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:16.429898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:16.430645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:16.431073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:16.456067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:16.456654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:16.463648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:16.464147 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:16.464951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:16.465390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:16.563471 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:16.571145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-09217208-56f6-486e-ae1c-66aa9d28c044 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.153170 May 24 14:00:16.571708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 219/428] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:16 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:16.598888 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:16.606853 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:16.608412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:16.609556 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4fbf638d-dc3f-4fa4-ae4e-b5afc0b8e517 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.157393 May 24 14:00:16.610120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 210/429] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:16 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:17.588433 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:17.589078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:17.595527 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:17.596021 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:17.596791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:17.597231 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:17.628231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:17.628963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:17.635899 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:17.636428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:17.637266 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:17.637772 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:17.723942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:17.731483 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8dc1dfcf-f681-403b-b07c-da5afc71e27f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.146865 May 24 14:00:17.732076 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 220/430] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:17 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:00:17.765997 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:17.774949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:17.776491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:17.777627 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9d15f09c-2939-4337-9070-5d13c92e7929 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.153286 May 24 14:00:17.778197 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 211/431] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:17 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:18.059313 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-2db6f74a-dafd-47e8-9703-170c463fac4a req-70afb573-9de8-4e23-84e0-f08301048edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840693fa-71a3-4a35-8979-596bfcc1aa86", "name": "network-vif-plugged", "status": "completed", "tag": "7c101693-d68b-41a9-ac5b-61fc73b8be1d"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:18.068263 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-2db6f74a-dafd-47e8-9703-170c463fac4a req-70afb573-9de8-4e23-84e0-f08301048edc service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:18.068734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-2db6f74a-dafd-47e8-9703-170c463fac4a req-70afb573-9de8-4e23-84e0-f08301048edc service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:18.081325 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-2db6f74a-dafd-47e8-9703-170c463fac4a req-70afb573-9de8-4e23-84e0-f08301048edc service nova] Creating event network-vif-plugged:7c101693-d68b-41a9-ac5b-61fc73b8be1d for instance 840693fa-71a3-4a35-8979-596bfcc1aa86 on hv-cinder-84212 May 24 14:00:18.086550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-2db6f74a-dafd-47e8-9703-170c463fac4a req-70afb573-9de8-4e23-84e0-f08301048edc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030914 May 24 14:00:18.087184 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 221/432] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:00:18.748381 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:18.748994 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:18.750985 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:18.757288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:18.757732 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:18.758491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:18.758926 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:18.792959 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:18.793783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:18.798232 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:18.798955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:18.807238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:18.807685 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:18.808469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:18.808894 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:18.891612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:18.899928 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5ba9346f-e153-4819-b570-1d089851d84e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.155623 May 24 14:00:18.900502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 212/433] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:18 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:18.941324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:18.950025 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:18.951544 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:18.952744 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6037ca23-0c24-414f-86f0-9d8f770971f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.160777 May 24 14:00:18.953299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 222/434] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:18 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:19.917053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:19.917664 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:19.923643 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:19.924133 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:19.924884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:19.925313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:19.974468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:19.975130 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:19.982540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:19.982990 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:19.983761 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:19.984224 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:20.057373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:20.064951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d7f0ec18-1feb-4593-bfa2-c0e09ac5355e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1368 microversion: 2.1 time: 0.151741 May 24 14:00:20.065526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 213/435] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:19 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:20.115214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:20.123392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:20.124932 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:20.126105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0b0c74eb-f1fa-4a4a-9b5e-ba0838d47501 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.156304 May 24 14:00:20.126657 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 223/436] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:19 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:21.084015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:21.084629 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:21.090646 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:21.091087 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:21.091861 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:21.092299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:21.144379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:21.145029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:21.151546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:21.152206 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:21.153071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:21.153574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:21.225406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:21.232872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bb9cbbc4-80f1-4a0e-b19a-0a5e157b5f76 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1558 microversion: 2.1 time: 0.153229 May 24 14:00:21.233447 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 214/437] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:00:21 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:00:21.249705 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:21.250201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:21.256303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:21.256761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:21.257528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:21.257971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:21.288535 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:21.296516 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:21.298040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:21.299199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-102b1cad-246c-4472-85ea-1a01b4e72f30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.159145 May 24 14:00:21.299756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 224/438] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:21 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:21.336009 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2b48ed0c-026c-4d92-a2bb-fb2d2bee271f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090166 May 24 14:00:21.336555 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 215/439] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 14:00:21 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:00:22.010417 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:00:22.010667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:00:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:00:22.317669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:22.318326 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:22.324776 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:22.325220 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:22.325981 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:22.326418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:22.438500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-ca8720d1-90a2-4d0c-bb02-b22b3b5589a0 req-fce900c3-afa5-4b8b-9464-e400f1f094f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840693fa-71a3-4a35-8979-596bfcc1aa86", "tag": "7c101693-d68b-41a9-ac5b-61fc73b8be1d"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:22.447233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-ca8720d1-90a2-4d0c-bb02-b22b3b5589a0 req-fce900c3-afa5-4b8b-9464-e400f1f094f8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:22.447679 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-ca8720d1-90a2-4d0c-bb02-b22b3b5589a0 req-fce900c3-afa5-4b8b-9464-e400f1f094f8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:22.459740 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-ca8720d1-90a2-4d0c-bb02-b22b3b5589a0 req-fce900c3-afa5-4b8b-9464-e400f1f094f8 service nova] Creating event network-changed:7c101693-d68b-41a9-ac5b-61fc73b8be1d for instance 840693fa-71a3-4a35-8979-596bfcc1aa86 on hv-cinder-84212 May 24 14:00:22.462421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:22.465594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-ca8720d1-90a2-4d0c-bb02-b22b3b5589a0 req-fce900c3-afa5-4b8b-9464-e400f1f094f8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030313 May 24 14:00:22.466409 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 216/440] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:00:22.470583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:22.472145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:22.473301 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ce11570a-10ef-4945-a52b-f5b0cb67dbfc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.160060 May 24 14:00:22.473846 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 225/441] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:22 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:23.491539 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:23.492783 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:23.499685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:23.500170 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:23.500945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:23.501377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:23.641761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:23.650495 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:23.652026 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:23.653160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e69f0be7-90d0-4c44-af51-8cc19392b75f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.166271 May 24 14:00:23.653713 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 217/442] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:23 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:24.670563 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:24.671089 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:24.678265 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:24.678713 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:24.679470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:24.679925 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:24.814131 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:24.822649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:24.824207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:24.825350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b6bfe7a6-50f9-4f9d-8b24-716ca2161a37 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.158817 May 24 14:00:24.825909 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 226/443] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:24 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:25.842531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:25.843163 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:25.849308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:25.849828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:25.850608 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:25.851032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:25.976699 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:25.984592 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:25.986120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:25.987270 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-49e81974-3678-4b5e-9f72-24450a21edb5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.148753 May 24 14:00:25.987851 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 218/444] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:25 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:27.006915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:27.007520 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:27.014003 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:27.014448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:27.015200 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:27.015630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:27.145742 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:27.153657 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:27.155187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:27.156369 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5f772ef0-e8f9-4e84-ab5b-3ba2e5bb138c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.153599 May 24 14:00:27.156928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 227/445] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:27 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:28.174896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:28.175463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:28.178542 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:28.183960 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:28.184412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:28.185172 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:28.185611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:28.316501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:28.324346 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:28.325862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:28.327003 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2ee75987-883e-409e-b14b-cfcb4e803ccc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1741 microversion: 2.20 time: 0.156106 May 24 14:00:28.327563 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 219/446] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:28 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:29.345560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:29.346189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:29.348724 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:29.354490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:29.354935 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:29.355723 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:29.356195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:29.360546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:29.487076 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:29.495765 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:29.497561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:29.498724 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9e28d54b-5b08-495f-bd40-793d225b4c67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1741 microversion: 2.20 time: 0.157091 May 24 14:00:29.499298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 228/447] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:29 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:30.517854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:30.518469 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:30.525267 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:30.525716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:30.526478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:30.526913 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:30.652107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:30.655489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:30.661347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:30.662790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:30.663999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b9850d37-6ef5-4aa0-b0bf-1112bc29eaed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1741 microversion: 2.20 time: 0.150094 May 24 14:00:30.664585 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 220/448] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:30 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:31.682151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:31.682764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:31.689227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:31.689676 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:31.690436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:31.690870 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:31.822184 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:31.830054 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:31.831578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:31.833139 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c6371307-7e86-46f7-87d6-4a8625dddacc tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1741 microversion: 2.20 time: 0.154904 May 24 14:00:31.833694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 229/449] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:31 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:32.117624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-d8573441-a123-4f08-ac82-7c3bc3940484 req-5537e41e-2421-4f9c-bb37-c3a4bf9027ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "name": "network-vif-plugged", "status": "completed", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:32.126836 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-d8573441-a123-4f08-ac82-7c3bc3940484 req-5537e41e-2421-4f9c-bb37-c3a4bf9027ac service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:32.127560 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-d8573441-a123-4f08-ac82-7c3bc3940484 req-5537e41e-2421-4f9c-bb37-c3a4bf9027ac service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:32.139746 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-d8573441-a123-4f08-ac82-7c3bc3940484 req-5537e41e-2421-4f9c-bb37-c3a4bf9027ac service nova] Creating event network-vif-plugged:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 14:00:32.144963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-d8573441-a123-4f08-ac82-7c3bc3940484 req-5537e41e-2421-4f9c-bb37-c3a4bf9027ac service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 May 24 14:00:32.145580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 221/450] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:00:32.851669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:32.852330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:32.858769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:32.859215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:32.859995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:32.860426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:32.997920 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:33.006864 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:33.008392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:33.009525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aa223eaf-06cd-4ac0-96e0-43963b693b68 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1741 microversion: 2.20 time: 0.162180 May 24 14:00:33.010083 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 230/451] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:32 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:34.028634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:34.029636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:34.037999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:34.038443 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:34.039496 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:34.040096 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:34.177555 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:34.186162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:34.188534 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:34.190233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-86a01973-7642-4833-a7ad-f7dce7fae8ae tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.165951 May 24 14:00:34.191701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 222/452] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:34 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:35.210694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:35.211408 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:35.218871 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:35.219397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:35.220279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:35.220781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:35.551228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:35.559260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:35.560840 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:35.562005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3753a0bb-dad6-4708-a993-4c789b47353e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.356841 May 24 14:00:35.562541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 231/453] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:35 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:36.580046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:36.580711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:36.587005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:36.587456 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:36.588342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:36.588785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:36.786397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:36.794261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:36.795780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:36.796950 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bffa9456-3bba-4001-8590-73edda2fd33f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.220924 May 24 14:00:36.797670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 223/454] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:36 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:37.814359 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:37.814966 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:37.830614 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:37.831083 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:37.831918 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:37.832357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:37.971276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:37.981310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:37.983017 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:37.984196 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f3d61ece-9662-4a63-b21c-526615366b95 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.173736 May 24 14:00:37.984746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 232/455] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:37 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:39.003093 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:39.004304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:39.010868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:39.011589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:39.012393 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:39.012828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:39.189075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:39.197963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:39.199355 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:39.200548 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1b2e3dfb-fbe5-4bd9-b522-316bd573e5ac tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.201431 May 24 14:00:39.210920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 224/456] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:38 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:39.555477 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:00:39.555703 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:00:40.219323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:40.219886 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:40.229317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:40.230180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:40.231474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:40.232221 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:40.407625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:40.420434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:40.422960 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:40.424811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b942741d-edf8-4f9f-bb17-a6d327b3494d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.210062 May 24 14:00:40.440292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 233/457] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:40 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:41.450342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:41.450996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:41.457900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:41.458351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:41.459115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:41.459568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:41.605356 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:41.613647 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:41.615248 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:41.616717 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d9fa1849-5d00-4661-a9e6-dc4cb17a45a6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.170137 May 24 14:00:41.617010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 225/458] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:41 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:42.636276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:42.637015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:42.645574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:42.646034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:42.646873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:42.647352 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:42.799294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:42.810299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:42.812901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:42.812901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eb90fcf1-931b-4841-8bd8-ef39dcec0e4e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.180485 May 24 14:00:42.813619 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 234/459] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:42 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:43.831419 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:43.832181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:43.839107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:43.839568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:43.840424 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:43.840874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:43.999868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:44.012103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:44.013639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:44.014816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c47722be-835d-4bf0-a7dc-545fcb421e10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.188159 May 24 14:00:44.015384 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 226/460] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:43 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:45.033233 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:45.033834 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:45.041092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:45.041539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:45.042298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:45.042729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:45.180935 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:45.188785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:45.190284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:45.191760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d5067e75-a31a-4f58-aa06-6b6117debc30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1736 microversion: 2.20 time: 0.162429 May 24 14:00:45.192341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 235/461] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:45 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:46.209800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:46.210418 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:46.216361 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:46.216810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:46.217588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:46.218011 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:46.348840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:46.358474 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:46.360046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:46.361201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-019dba95-2bbb-45b8-9e60-69e3aa28c838 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1718 microversion: 2.20 time: 0.155543 May 24 14:00:46.361759 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 227/462] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:46 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:47.382370 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:47.382981 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:47.389618 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:47.390075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:47.390842 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:47.391284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:47.519897 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:47.527756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:47.529307 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:47.530458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7ad8a41c-736f-4641-ac06-f1555b4e44d4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1718 microversion: 2.20 time: 0.152617 May 24 14:00:47.531019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 236/463] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:47 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:48.183258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-656ea805-59ee-49b2-92d9-7c8a4a34fb5c req-9c76b557-69a3-4914-8344-8d0b6a3f877e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "name": "network-vif-unplugged", "status": "completed", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:48.192236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-656ea805-59ee-49b2-92d9-7c8a4a34fb5c req-9c76b557-69a3-4914-8344-8d0b6a3f877e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:48.192906 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-656ea805-59ee-49b2-92d9-7c8a4a34fb5c req-9c76b557-69a3-4914-8344-8d0b6a3f877e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:48.205720 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-656ea805-59ee-49b2-92d9-7c8a4a34fb5c req-9c76b557-69a3-4914-8344-8d0b6a3f877e service nova] Creating event network-vif-unplugged:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 14:00:48.210829 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-656ea805-59ee-49b2-92d9-7c8a4a34fb5c req-9c76b557-69a3-4914-8344-8d0b6a3f877e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031267 May 24 14:00:48.211421 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 228/464] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:00:48.548372 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:48.548987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:48.556121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:48.556574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:48.557345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:48.557803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:48.689526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:48.698355 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:48.699878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:48.701039 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-30eb5188-3b9f-4cb7-a4d6-fe42e663b304 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1661 microversion: 2.20 time: 0.156562 May 24 14:00:48.701596 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 237/465] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:48 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:48.720053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d1e7536-d6f4-455f-8cbb-f9e5a219270b"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:48.721191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:48.727767 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:48.728280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:48.729048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:48.729484 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:49.008016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-16fb5a05-2e1b-4025-9358-c8acd165a61c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292341 May 24 14:00:49.008611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 229/466] 10.222.0.24 () {62 vars in 1363 bytes} [Tue May 24 14:00:48 2022] POST /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 14:00:49.121057 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:49.121620 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:49.127729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:49.128563 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:49.129510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:49.129946 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:49.218444 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6784adb8-ba44-4732-863c-0991cb0736e5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/action" status: 202 len: 0 microversion: 2.20 time: 0.101219 May 24 14:00:49.219050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 238/467] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 24 14:00:49 2022] POST /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 14:00:49.227580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:49.228217 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:49.235467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:49.236164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:49.237727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:49.238411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:49.372044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:49.382374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:49.384249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:49.385318 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-451c8176-412c-4b94-bd91-32037813f97d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1747 microversion: 2.20 time: 0.161593 May 24 14:00:49.385911 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 230/468] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:49 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:50.404755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:50.405358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:50.411879 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:50.412329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:50.413111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:50.413540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:50.543311 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:50.552922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:50.554441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:50.555596 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f22a7bc8-aef7-4b9c-b799-495f2c9ee933 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1749 microversion: 2.20 time: 0.155646 May 24 14:00:50.556187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 239/469] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:50 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:51.574251 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:51.574847 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:51.580840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:51.581297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:51.582709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:51.583113 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:51.711226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:51.720109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:51.721610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:51.722755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8d538723-e2f7-4f29-b6da-18b88890d589 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.152374 May 24 14:00:51.723307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 231/470] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:51 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:52.741788 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:52.742384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:52.748661 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:52.749102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:52.749853 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:52.750280 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:52.899280 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:52.907872 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:52.909386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:52.910528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2df9a8ad-094e-4b8f-b714-9800ee959d9a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.173451 May 24 14:00:52.911080 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 240/471] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:52 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:53.930475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:53.931255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:53.937707 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:53.938161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:53.938931 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:53.939363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:54.079633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:54.088204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:54.089725 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:54.090875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0ebdaeb9-70b0-4791-b234-e3ef0d489367 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.165384 May 24 14:00:54.091439 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 232/472] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:53 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:55.110667 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:55.112128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aff80817-6ad4-46a8-bf70-1c8faec2d041"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:00:55.113863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:55.114498 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:55.121384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:55.122428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:55.122627 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:55.123291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:55.123634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:55.124208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:55.124508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:55.124955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:55.285810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:55.295363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:55.296898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:55.298055 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2509279e-52fe-4556-97fd-2760f3ccab13 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.192531 May 24 14:00:55.298648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 233/473] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:55 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:56.317207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:56.319863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:56.325698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:56.326142 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:56.326906 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:56.332343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:56.500057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:56.511024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:56.512628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:56.513835 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8bdf8676-daf7-4bea-a1f8-869ccb849afe tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.201271 May 24 14:00:56.514399 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 234/474] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:56 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:57.534166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:57.535982 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:57.545149 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:57.546141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:57.547385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:57.548136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:57.685247 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:57.693803 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:57.695321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:57.696503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e0dde37c-3b51-48b8-89f9-ffbafd3ee931 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.167880 May 24 14:00:57.697064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 235/475] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:57 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:00:58.714879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:58.715629 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:58.717603 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=34 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:58.724816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:58.725266 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:58.726354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:58.726881 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:58.739364 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:00:58.875909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:58.884645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:58.886222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:00:58.887461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-087d61ea-ab77-4e45-a3d0-f46f46790b47 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.176638 May 24 14:00:58.888295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 236/476] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:58 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:00:59.905896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:00:59.906616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:00:59.913321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:59.913685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:00:59.914464 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:00:59.914905 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:00.050630 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:00.059910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:00.061429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:00.062610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-47ad945c-b5bb-45a8-b8f8-083c4bebe3e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.160600 May 24 14:01:00.063362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 237/477] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:00:59 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:01.086827 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:01.088284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:01.112118 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:01.112941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:01.113726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:01.114317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:01.258970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:01.268102 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:01.269609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:01.270807 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3db80dbb-1934-4d20-aedd-f3eb03baa68f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.192130 May 24 14:01:01.271716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 238/478] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:01 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:02.289708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:02.290352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:02.296360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:02.296805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:02.297554 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:02.297984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:02.428632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:02.436884 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:02.438388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:02.439532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d06d30b0-16f8-4d7a-931b-95d15ef5d474 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.153822 May 24 14:01:02.440156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 239/479] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:02 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:03.457549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:03.458213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:03.464766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:03.465204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:03.465950 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:03.466379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:03.595285 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:03.603879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:03.605406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:03.606531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c6ec7ead-62a7-472c-9486-622c41cabaee tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.152876 May 24 14:01:03.607084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 240/480] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:03 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:04.625415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:04.626017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:04.632751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:04.633196 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:04.633941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:04.634367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:04.762652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:04.771103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:04.772759 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:04.773913 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b4101d18-9e5d-4585-b59b-485189e467d3 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.152668 May 24 14:01:04.774470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 241/481] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:04 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:05.121762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=29 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:05.207405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:05.792013 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:05.792545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:05.798501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:05.798949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:05.799700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:05.800156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:05.929680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:05.937967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:05.939488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:05.940652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d45978c8-8efa-4f1a-82d0-d3ee5b0cdc9c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.152640 May 24 14:01:05.941213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 242/482] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:05 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:06.959862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:06.960576 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:06.966978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:06.967435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:06.968238 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:06.968682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:06.978080 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eab28acf-cb06-41d0-8af2-99dbe2408e9b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.988258 May 24 14:01:06.983270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 241/483] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:00:54 2022] POST /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments => generated 194 bytes in 11990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:01:07.102863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:07.111257 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:07.112793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:07.114425 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-66c3423a-08f8-46e1-ba63-61ade1085807 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.158717 May 24 14:01:07.114549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 243/484] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:06 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:08.133969 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:08.134590 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:08.140799 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:08.141244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:08.141996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:08.142426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:08.270506 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:08.279302 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:08.280834 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:08.281968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a85f07b9-d30a-4ee3-a754-2d46d3305e74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.152895 May 24 14:01:08.282522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 242/485] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:08 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:09.301122 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:09.301720 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:09.308622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:09.309044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:09.309792 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:09.310219 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:09.439253 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:09.447575 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:09.449119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:09.450263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a9540e3b-0ec7-4fe2-b2bb-e3273e3c21ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.153107 May 24 14:01:09.450831 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 244/486] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:09 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:10.468640 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:10.469201 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:10.476050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:10.476502 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:10.477273 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:10.477709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:10.621930 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:10.630883 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:10.632445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:10.633593 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-46078185-afb4-4690-88cc-7b6a815832fa tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.168936 May 24 14:01:10.634176 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 243/487] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:10 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:11.652528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:11.653170 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:11.659267 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:11.659719 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:11.660514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:11.660956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:11.794733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:11.803883 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:11.805392 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:11.806523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f707e3b0-c704-4f29-a6e1-9bdcfd64b298 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.157951 May 24 14:01:11.807073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 245/488] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:11 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:12.824639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:12.825169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:12.831552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:12.832040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:12.832797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:12.833844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:12.959695 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:12.968004 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:12.969526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:12.970679 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bb86eeaf-e134-4cf1-a4e9-a62a8ff46488 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.149986 May 24 14:01:12.971244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 244/489] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:12 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:13.988255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:13.988855 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:13.996727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:13.997178 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:13.997969 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:13.998404 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:14.123939 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:14.132712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:14.134224 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:14.135357 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-49b62c60-83d8-4d88-87e4-73602cef575c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.151042 May 24 14:01:14.135941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 246/490] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:13 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:15.153726 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:15.154262 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:15.160676 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:15.161134 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:15.162175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:15.162616 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:15.288673 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:15.297007 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:15.298518 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:15.299663 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eb0a1f19-ac1a-40c8-a924-6b9c654fa6b8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.150017 May 24 14:01:15.300264 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 245/491] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:15 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:15.523931 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:01:15.524940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:15.530897 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:15.531340 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:15.532116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:15.532549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:15.555583 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lazy-loading 'flavor' on Instance uuid 9efba3b6-0b80-48c5-ac89-0db944e2ac8f {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:01:15.677246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f6c7bdec-d9f1-4729-ba7b-3fcefa358f27 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/action" status: 200 len: 32 microversion: 2.1 time: 0.157189 May 24 14:01:15.677949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 247/492] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:01:15 2022] POST /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:01:15.687053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:15.687921 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:15.694431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:15.694958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:15.695731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:15.696197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:15.922350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:15.930627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a73f9341-f438-47ea-a06b-9da5d579328e tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.247457 May 24 14:01:15.931137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 246/493] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:15 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:16.318999 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:16.319698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:16.326949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:16.327401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:16.328197 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:16.328815 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:16.475492 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:16.486056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:16.491022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:16.493288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9f502c24-0d5b-4b60-b130-fa2a33611b4c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.178408 May 24 14:01:16.493849 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 248/494] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:16 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:01:16.497281 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-366a39be-ac6f-412b-8862-e379596a7da1 req-699cb4cd-40d2-47ca-96f5-72b0ab08930d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "name": "network-vif-plugged", "status": "completed", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:01:16.506029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-366a39be-ac6f-412b-8862-e379596a7da1 req-699cb4cd-40d2-47ca-96f5-72b0ab08930d service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:16.506474 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-366a39be-ac6f-412b-8862-e379596a7da1 req-699cb4cd-40d2-47ca-96f5-72b0ab08930d service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:16.518283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-366a39be-ac6f-412b-8862-e379596a7da1 req-699cb4cd-40d2-47ca-96f5-72b0ab08930d service nova] Creating event network-vif-plugged:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 14:01:16.523279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-366a39be-ac6f-412b-8862-e379596a7da1 req-699cb4cd-40d2-47ca-96f5-72b0ab08930d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111179 May 24 14:01:16.523897 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 247/495] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:01:16.949691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:16.950292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:16.956412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:16.956853 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:16.957617 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:16.958175 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:17.096347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:17.108015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c1c78e49-2233-45d8-87eb-5f26481bbf23 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.163378 May 24 14:01:17.108611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 249/496] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:16 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:17.513113 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:17.513863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:17.520083 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:17.521205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:17.522106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:17.522540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:17.653050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:17.661419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:17.662974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:17.664154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aaa9bb9f-f60b-4684-b23f-f0c27adf3458 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.155713 May 24 14:01:17.664714 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 248/497] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:17 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:18.126604 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:18.127118 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:18.133739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:18.134181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:18.134930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:18.135359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:18.260055 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:18.263577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:18.268863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ce32320a-3c3b-4bb8-acf4-a63636e34cb7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.146206 May 24 14:01:18.269431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 250/498] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:18 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:18.682294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:18.682919 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:18.689379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:18.689822 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:18.690577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:18.691010 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:18.816509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:18.824898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:18.826425 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:18.827578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b2670b5-81fb-46d2-a740-27d0555e4a82 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.149216 May 24 14:01:18.828177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 249/499] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:18 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:19.286688 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:19.287292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:19.293823 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:19.294268 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:19.295024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:19.295453 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:19.432179 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:19.440729 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ecda76d1-cb77-4902-9449-862bac15a075 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.158606 May 24 14:01:19.441296 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 251/500] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:19 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:19.847473 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:19.848146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:19.854783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:19.855227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:19.856287 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:19.856721 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:19.989619 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:19.998987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:20.000644 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:20.001838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6efd676f-a15c-452d-b63a-a9dbc7b4570a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1805 microversion: 2.20 time: 0.158274 May 24 14:01:20.002408 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 250/501] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:19 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:20.460218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:20.460827 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:20.466764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:20.467202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:20.467974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:20.468403 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:20.599696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:20.607575 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-67bda3a3-b3b5-40ef-8d48-af61b589d3d6 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.152168 May 24 14:01:20.608188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 252/502] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:20 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:21.020274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:21.020898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:21.027445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:21.027929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:21.028693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:21.029130 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:21.155784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:21.164241 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:21.165805 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:21.166953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-96661963-bfd1-4638-bfba-a0572c65be1e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1792 microversion: 2.20 time: 0.150606 May 24 14:01:21.167521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 251/503] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:01:21 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1792 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:01:21.625215 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:21.625845 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:21.631984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:21.632363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:21.633109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:21.633566 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:21.763451 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:21.772252 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-872e967e-5bc2-4a57-8df5-4ea4ba16322f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.151118 May 24 14:01:21.772824 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 253/504] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:21 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:22.789538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:22.790075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:22.796836 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:22.797292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:22.798056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:22.798494 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:22.924041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:22.931986 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-095d1bce-68f7-4966-a389-658ea12116fa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.146482 May 24 14:01:22.932551 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 252/505] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:22 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:23.949564 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:23.950283 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:23.956225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:23.956674 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:23.957932 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:23.958518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:24.084513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:24.092325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9adc334b-e9ae-4d97-8465-c2302eb8fb10 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.146757 May 24 14:01:24.092879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 254/506] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:23 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:25.110276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:25.111010 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:25.118507 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:25.118954 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:25.119718 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:25.120190 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:25.251099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:25.259061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-91429e5b-8bcb-4dc5-b5bd-fec97fbe9f86 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.153035 May 24 14:01:25.259630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 253/507] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:25 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:26.276435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:26.277052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:26.283096 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:26.283544 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:26.284336 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:26.284803 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:26.413587 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:26.421463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bb375243-7f6c-4e71-84e0-d6c70ec6c38c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.148874 May 24 14:01:26.422031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 255/508] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:26 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:27.438342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:27.438939 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:27.445972 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:27.446407 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:27.447158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:27.447587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:27.574844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:27.582962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-65c91e75-5a1c-42f4-bee2-21f6617bcc07 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.148312 May 24 14:01:27.583534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 254/509] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:27 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:28.600547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:28.601154 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:28.607140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:28.607585 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:28.608383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:28.608821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:28.733894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:28.742119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6566a6ee-705c-4bc8-8b25-5bbd8bbf79fc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.146115 May 24 14:01:28.742677 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 256/510] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:28 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:29.760249 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:29.760857 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:29.767305 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:29.767751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:29.768544 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:29.768996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:29.898695 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:29.906748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-22f6750b-9e73-4ca6-915a-bd50a5084fcc tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.150491 May 24 14:01:29.907317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 255/511] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:29 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:30.924342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:30.924954 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:30.926869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=42 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:30.932261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:30.932712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:30.933473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:30.933915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:31.059656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:31.068029 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fd53092f-6e1b-4577-a438-a36b265c5d96 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.147768 May 24 14:01:31.068599 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 257/512] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:30 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:32.085917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:32.086521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:32.093072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:32.093523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:32.094283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:32.094715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:32.226006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:32.233865 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9eec7239-b759-45d5-a568-7350a040687f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.152447 May 24 14:01:32.234422 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 256/513] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:32 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:33.251594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:33.252225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:33.258288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:33.258739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:33.259499 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:33.259968 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:33.393793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:33.401898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e1aa1342-da33-4b4d-b97c-cd9fbb92a29b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.154193 May 24 14:01:33.402466 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 258/514] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:33 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:34.419626 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:34.420282 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:34.427373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:34.427807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:34.428578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:34.429007 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:34.559706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:34.563188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:34.569484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f79587c4-6dfd-44da-bce4-a0d3dbee380d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1736 microversion: 2.1 time: 0.153775 May 24 14:01:34.570046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 257/515] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:34 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:35.587255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:35.587972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:35.594841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:35.595338 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:35.596240 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:35.596684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:35.727422 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:35.735304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4219d269-ebb7-4f63-bf2d-bf3e37e076c2 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1716 microversion: 2.1 time: 0.152206 May 24 14:01:35.735879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 259/516] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:35 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:35.790989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:35.791509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:35.793767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=33 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:35.799806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:35.800279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:35.801571 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:35.802024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:35.932920 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] HTTP exception thrown: Cannot 'detach_volume' instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f while it is in vm_state rescued May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Request method failure captured: May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments/aff80817-6ad4-46a8-bf70-1c8faec2d041 HTTP/1.1 May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPh81quQjnD-qmdosxKbMMw-h-WryCXpaNbCqNl1mGxuZnbA1wePY8nRZkc94zTX7ff-on65-_evJ5KGEs43TvjvpPHl93PvGkREv1jt67q2qiB2Y4qHvYsNPlVE4KsMHNJqUQexrkRXstmH5S3SWH3r8FLj1FMkfJQqGtZXNI6H4A May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:01:35.934558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_54ee7d13408645e6b6517f541fe45670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 532b36f272dc432aad6faa294bd1bc6c May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:01:35.936180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Cannot 'detach_volume' instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f while it is in vm_state rescued May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': '9efba3b6-0b80-48c5-ac89-0db944e2ac8f', 'id': 'aff80817-6ad4-46a8-bf70-1c8faec2d041'} May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f in vm_state rescued. Cannot detach_volume while the instance is in this state. May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:01:35.936942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f while it is in vm_state rescued May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f while it is in vm_state rescued May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:01:35.938154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Returning 409 to user: Cannot 'detach_volume' instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f while it is in vm_state rescued {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:01:35.939112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9b8727e5-bf17-4d53-8b2c-0a3646f0d465 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments/aff80817-6ad4-46a8-bf70-1c8faec2d041" status: 409 len: 152 microversion: 2.1 time: 0.149579 May 24 14:01:35.939112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 258/517] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:01:35 2022] DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments/aff80817-6ad4-46a8-bf70-1c8faec2d041 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 14:01:35.945656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:01:35.946190 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:35.952234 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:35.952680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:35.953438 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:35.953872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:36.017652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1d7fa34f-4ea3-4bd6-8db9-eee4813e1cef tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "POST /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/action" status: 202 len: 0 microversion: 2.1 time: 0.076298 May 24 14:01:36.018545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 260/518] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:01:35 2022] POST /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:01:36.028758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:36.029142 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:36.036244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:36.036700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:36.037480 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:36.037927 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:36.167357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:36.175938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4a5f0d8b-3021-4b5e-9f06-2c9e54109c87 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1724 microversion: 2.1 time: 0.150766 May 24 14:01:36.176500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 259/519] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:36 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:37.195051 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:37.195753 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:37.201909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:37.202358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:37.203109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:37.203543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:37.341254 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:37.349615 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-804bf913-693f-480d-a5e3-0983097b68b7 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1724 microversion: 2.1 time: 0.159821 May 24 14:01:37.350174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 261/520] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:37 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:38.367499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:38.368141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:38.374819 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:38.375272 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:38.376066 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:38.376505 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:38.502648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:38.511180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-57a768d2-e1bd-4a46-bebb-e3217356c1bf tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1724 microversion: 2.1 time: 0.148117 May 24 14:01:38.511751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 260/521] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:38 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:39.527984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:39.528594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:39.535307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:39.535761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:39.536568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:39.537005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:39.668393 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:39.676909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-645cf99d-15c0-45ed-8f39-fe93dd7a9a0f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1724 microversion: 2.1 time: 0.152758 May 24 14:01:39.677484 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 262/522] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:39 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:40.698008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:40.698635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:40.712543 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:40.712998 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:40.713784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:40.714222 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:40.847611 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:40.855562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a923647f-55a6-4f56-95eb-9e75058be761 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1730 microversion: 2.1 time: 0.164771 May 24 14:01:40.856169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 261/523] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:40 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:01:40.873204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:40.873765 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:40.879849 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:40.880296 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:40.881141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:40.881591 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:40.962165 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-852f9181-87a2-48e8-8d5b-959c4b3e0101 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093002 May 24 14:01:40.962757 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 263/524] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 14:01:40 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:01:42.159667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7d69c822-910c-4d58-b5da-37ca5592feae req-6d2adf0d-bd2d-4e9c-b3a6-6f8add317a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efba3b6-0b80-48c5-ac89-0db944e2ac8f", "tag": "6ec58c80-6380-4300-8c4d-013be3a1d9bb"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:01:42.167839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7d69c822-910c-4d58-b5da-37ca5592feae req-6d2adf0d-bd2d-4e9c-b3a6-6f8add317a8b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:42.168377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7d69c822-910c-4d58-b5da-37ca5592feae req-6d2adf0d-bd2d-4e9c-b3a6-6f8add317a8b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:42.182496 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7d69c822-910c-4d58-b5da-37ca5592feae req-6d2adf0d-bd2d-4e9c-b3a6-6f8add317a8b service nova] Creating event network-changed:6ec58c80-6380-4300-8c4d-013be3a1d9bb for instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f on hv-cinder-84212 May 24 14:01:42.187667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7d69c822-910c-4d58-b5da-37ca5592feae req-6d2adf0d-bd2d-4e9c-b3a6-6f8add317a8b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088310 May 24 14:01:42.188505 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 262/525] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:01:44.202056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-716ba890-7102-45c3-9e31-c830f4796349 req-8714ad00-9888-447f-8b2d-94494eae60f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efba3b6-0b80-48c5-ac89-0db944e2ac8f", "tag": "6ec58c80-6380-4300-8c4d-013be3a1d9bb"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:01:44.210681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-716ba890-7102-45c3-9e31-c830f4796349 req-8714ad00-9888-447f-8b2d-94494eae60f7 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:44.211117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-716ba890-7102-45c3-9e31-c830f4796349 req-8714ad00-9888-447f-8b2d-94494eae60f7 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:44.223025 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-716ba890-7102-45c3-9e31-c830f4796349 req-8714ad00-9888-447f-8b2d-94494eae60f7 service nova] Creating event network-changed:6ec58c80-6380-4300-8c4d-013be3a1d9bb for instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f on hv-cinder-84212 May 24 14:01:44.227971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-716ba890-7102-45c3-9e31-c830f4796349 req-8714ad00-9888-447f-8b2d-94494eae60f7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029669 May 24 14:01:44.228594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 264/526] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:01:58.890342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=9 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:58.891072 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=26 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:58.896041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:58.896627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:58.903484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:58.903962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:58.904726 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:58.905162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:58.929147 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:01:59.000298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6f77d0e3-7bc9-4622-935f-69a02eb76a9c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "DELETE /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 204 len: 0 microversion: 2.1 time: 0.111302 May 24 14:01:59.001239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 263/527] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:01:58 2022] DELETE /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:01:59.007147 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=15 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:59.007921 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:01:59.011936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:01:59.012629 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:01:59.020759 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:59.021202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:59.021956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:01:59.022384 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:01:59.154293 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:01:59.162065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-072a2143-0962-4d76-b10b-1d92f1b64f9b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1576 microversion: 2.1 time: 0.156036 May 24 14:01:59.162628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 265/528] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:01:59 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:00.180717 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:00.181330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:00.187744 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:00.188224 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:00.188975 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:00.190056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:00.318167 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:00.325471 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cfe7a972-fa2f-4767-8309-b4b3171aed95 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1576 microversion: 2.1 time: 0.149075 May 24 14:02:00.326029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 264/529] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:00 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:01.342904 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:01.343492 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:01.349687 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:01.350133 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:01.350880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:01.351308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:01.484948 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:01.493032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f80e6a53-96ac-49be-8fc1-ceb9d39b6ea1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1576 microversion: 2.1 time: 0.154018 May 24 14:02:01.493812 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 266/530] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:01 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:02.027784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-e1090fd4-2b0f-437d-996b-2442ce65faa4 req-46bb2ccc-fec0-4359-93c3-f4f81afdcfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975be349-7e4e-4048-b0e1-471723fa08a0", "name": "network-vif-deleted", "tag": "446094fa-479e-4763-a75c-d6f1bca52a15"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:02.038014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-e1090fd4-2b0f-437d-996b-2442ce65faa4 req-46bb2ccc-fec0-4359-93c3-f4f81afdcfb5 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:02.038617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-e1090fd4-2b0f-437d-996b-2442ce65faa4 req-46bb2ccc-fec0-4359-93c3-f4f81afdcfb5 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:02.051505 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-e1090fd4-2b0f-437d-996b-2442ce65faa4 req-46bb2ccc-fec0-4359-93c3-f4f81afdcfb5 service nova] Creating event network-vif-deleted:446094fa-479e-4763-a75c-d6f1bca52a15 for instance 975be349-7e4e-4048-b0e1-471723fa08a0 on hv-cinder-84212 May 24 14:02:02.057042 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-e1090fd4-2b0f-437d-996b-2442ce65faa4 req-46bb2ccc-fec0-4359-93c3-f4f81afdcfb5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111428 May 24 14:02:02.057770 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 265/531] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:02.513271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:02.514120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:02.520823 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:02.521326 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:02.522114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:02.522776 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:02.553021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:02.553508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:02.553955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lazy-loading 'fault' on Instance uuid 975be349-7e4e-4048-b0e1-471723fa08a0 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:02:02.595454 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:02.608064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-64595cee-1285-40c1-b83c-03ee7d06b59d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 200 len: 1230 microversion: 2.1 time: 0.098035 May 24 14:02:02.610411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 267/532] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:02 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:03.626085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:03.626794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:03.633169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:03.634270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:03.635097 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:03.635541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:03.650251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] HTTP exception thrown: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Request method failure captured: May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 HTTP/1.1 May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijORbeX6MQPDdUtMnNIV45pRouMn9EHpkWgowiJhiRiPlODMlY4x40paUiOS_waWf0sI6pv_ZurzK0m6m1dLV3RwISA41imYHcdgsKODj0WksMXMOqH3OfEVvMNHYnTzpNYcfYRHarmkCDZ7x9lrK0cgwW_qi1u76SKputTV_3vvR43A May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:02:03.652092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestVolumeBootPattern-1763825507 May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestVolumeBootPattern-1763825507-project May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3acb774848a74e74a5886ee681ed205c May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestVolumeBootPattern-1763825507-project May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:02:03.653710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '975be349-7e4e-4048-b0e1-471723fa08a0'} May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:02:03.654561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:02:03.655797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:03.656928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Returning 404 to user: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:02:03.656928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e40c7063-2caa-42d0-a86e-b5c175547863 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 404 len: 111 microversion: 2.1 time: 0.032178 May 24 14:02:03.656928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 266/533] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:03 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:02:03.750332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1450058892", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-131305348", "security_groups": [{"name": "tempest-secgroup-smoke-281582916"}], "block_device_mapping_v2": [{"uuid": "e1e4dc8d-78c4-4084-b008-f8510a2cd10f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da184706-a3cd-4a03-bf62-0c961d1fd5b4"}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:03.866913 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] validate_networks() for [('da184706-a3cd-4a03-bf62-0c961d1fd5b4', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:02:04.279432 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:02:04.279895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:02:04.280499 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:02:04.280912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:02:04.281321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:02:04.291930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:04.292304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:04.293100 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:04.293532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:04.311144 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:02:04.315239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for user 3acb774848a74e74a5886ee681ed205c and project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:02:04.378610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:02:04.380760 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1e4dc8d-78c4-4084-b008-f8510a2cd10f',volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:02:04.517026 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fe9e4e84-cea7-4dea-8cf9-dbadec5bb084 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770431 May 24 14:02:04.519203 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 268/534] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:02:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:02:04.528156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-47ce38e5-7fa4-4e36-a593-cb4e9aa4ad1f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:04.529032 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-47ce38e5-7fa4-4e36-a593-cb4e9aa4ad1f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:04.594871 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-47ce38e5-7fa4-4e36-a593-cb4e9aa4ad1f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:04.603256 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-47ce38e5-7fa4-4e36-a593-cb4e9aa4ad1f tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1094 microversion: 2.1 time: 0.078802 May 24 14:02:04.612794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 267/535] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:04 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:05.620962 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:05.622446 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:05.628772 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:05.629216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:05.629977 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:05.630572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:05.696367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:05.704092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-78f20b94-1136-4348-bf5b-ec68611e8765 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1210 microversion: 2.1 time: 0.087428 May 24 14:02:05.704709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 269/536] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:05 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:06.721758 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:06.722385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:06.730968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:06.731583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:06.732959 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:06.733407 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:06.856665 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-d1c38324-c516-4d5a-b53c-7bdb1218addc req-12fece9c-05e3-4a87-983c-a1de65811097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718e90d7-f726-442e-b00a-5289fb2558de", "tag": "992b9bb4-a542-4387-82ba-0758b4b5ebb0"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:06.867076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-d1c38324-c516-4d5a-b53c-7bdb1218addc req-12fece9c-05e3-4a87-983c-a1de65811097 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:06.867533 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-d1c38324-c516-4d5a-b53c-7bdb1218addc req-12fece9c-05e3-4a87-983c-a1de65811097 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:06.884995 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-d1c38324-c516-4d5a-b53c-7bdb1218addc req-12fece9c-05e3-4a87-983c-a1de65811097 service nova] Creating event network-changed:992b9bb4-a542-4387-82ba-0758b4b5ebb0 for instance 718e90d7-f726-442e-b00a-5289fb2558de on hv-cinder-84212 May 24 14:02:06.891044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-d1c38324-c516-4d5a-b53c-7bdb1218addc req-12fece9c-05e3-4a87-983c-a1de65811097 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040228 May 24 14:02:06.891656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 270/537] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:02:06.973849 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:06.981749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2cbd0159-c681-4bc3-a5e8-48baca1899b7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.264688 May 24 14:02:06.982625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 268/538] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:06 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:07.541223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:07.541747 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:07.547885 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.548407 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.549350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.549787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.572065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9f5528e7-9dac-4b5b-82d9-cadd7be6a80a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/ips" status: 200 len: 149 microversion: 2.1 time: 0.091288 May 24 14:02:07.572612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 271/539] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 14:02:07 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/ips => generated 149 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:07.584121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d11144b6-a1df-4f35-a775-19c3cfded00c"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:07.585265 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:07.591127 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.591569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.592357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.592795 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.671038 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Invalid volume: volume d11144b6-a1df-4f35-a775-19c3cfded00c is already attached to instances: 9302a225-a5b2-456b-97ef-a6c329608645 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: POST /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/os-volume_attachments HTTP/1.1 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 74 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:02:07.672648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {"volumeAttachment": {"volumeId": "d11144b6-a1df-4f35-a775-19c3cfded00c"}} May 24 14:02:07.674258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Invalid volume: volume d11144b6-a1df-4f35-a775-19c3cfded00c is already attached to instances: 9302a225-a5b2-456b-97ef-a6c329608645 May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': '840693fa-71a3-4a35-8979-596bfcc1aa86', 'body': {'volumeAttachment': {'volumeId': 'd11144b6-a1df-4f35-a775-19c3cfded00c'}}} May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d11144b6-a1df-4f35-a775-19c3cfded00c is already attached to instances: 9302a225-a5b2-456b-97ef-a6c329608645 May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:07.675168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d11144b6-a1df-4f35-a775-19c3cfded00c is already attached to instances: 9302a225-a5b2-456b-97ef-a6c329608645 May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:07.676678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d11144b6-a1df-4f35-a775-19c3cfded00c is already attached to instances: 9302a225-a5b2-456b-97ef-a6c329608645 May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 400 to user: Invalid volume: volume d11144b6-a1df-4f35-a775-19c3cfded00c is already attached to instances: 9302a225-a5b2-456b-97ef-a6c329608645 {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7ffc6ca6-70e5-4cb7-b9a3-b7b200b48864 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095442 May 24 14:02:07.678085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 269/540] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:02:07 2022] POST /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 14:02:07.683252 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:07.683751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:07.690312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.690755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.691514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.691988 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.716953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:02:07.789516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-841b3857-d9ce-4ad4-94dd-c3854668c37f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 204 len: 0 microversion: 2.1 time: 0.109756 May 24 14:02:07.790094 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 272/541] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:02:07 2022] DELETE /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:02:07.798204 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:07.798854 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:07.805942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.806385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.807135 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:07.807564 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:07.941548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:07.954732 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4850d4d2-e960-492c-9d16-980cc44562a3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1682 microversion: 2.1 time: 0.160346 May 24 14:02:07.955304 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 270/542] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:07 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:07.999589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:08.000307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:08.006971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:08.007411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:08.008194 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:08.008624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:08.139152 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:08.146748 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f4d804fc-56ae-4051-8746-a2f02aec875a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.151264 May 24 14:02:08.147316 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 273/543] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:07 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:08.975989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:08.976551 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:08.982976 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:08.983414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:08.984200 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:08.984629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:09.114000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:09.121597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-37e55bb1-fafd-4718-8130-89f812ab9a5e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1682 microversion: 2.1 time: 0.149614 May 24 14:02:09.122191 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 271/544] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:08 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:09.164232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:09.164838 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:09.170805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:09.171258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:09.172041 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:09.172474 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:09.299871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:09.307195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-89af7c7a-17e2-47fe-82ae-b7f73d03c662 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.146827 May 24 14:02:09.307757 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 274/545] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:09 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:10.137984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:10.138521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:10.145194 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:10.145628 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:10.146374 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:10.146801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:10.271224 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:10.278518 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4bd09a2a-c539-4f42-b74a-2876d6b78eee tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1682 microversion: 2.1 time: 0.144473 May 24 14:02:10.279079 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 272/546] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:10 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:10.326508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:10.327132 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:10.333909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:10.334350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:10.335095 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:10.335521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:10.466920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:10.475004 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0ddc452f-7d03-4ecd-8c98-c9cc078bb3cd tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.152439 May 24 14:02:10.475569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 275/547] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:10 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:11.297377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:11.298550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:11.305244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:11.305755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:11.306470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:11.306908 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:11.434080 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:11.442041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-47e94c68-4cac-4df3-ab44-f42072c41361 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1682 microversion: 2.1 time: 0.148532 May 24 14:02:11.442604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 273/548] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:11 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:11.492442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:11.493798 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:11.500597 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:11.501053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:11.501870 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:11.502343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:11.751580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:11.760690 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1ea59639-2bd8-4943-b2a0-0bbeea89663d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.272051 May 24 14:02:11.761272 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 276/549] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:11 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:12.439867 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-da643976-9be3-4cb2-97b8-1b06673d21af req-684326ca-932a-4ec5-b541-52726f407588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840693fa-71a3-4a35-8979-596bfcc1aa86", "name": "network-vif-deleted", "tag": "7c101693-d68b-41a9-ac5b-61fc73b8be1d"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:12.451001 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-da643976-9be3-4cb2-97b8-1b06673d21af req-684326ca-932a-4ec5-b541-52726f407588 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:12.451860 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-da643976-9be3-4cb2-97b8-1b06673d21af req-684326ca-932a-4ec5-b541-52726f407588 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:12.458739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:12.459351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:12.466435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:12.466885 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:12.467811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:12.468338 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:12.477864 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-da643976-9be3-4cb2-97b8-1b06673d21af req-684326ca-932a-4ec5-b541-52726f407588 service nova] Creating event network-vif-deleted:7c101693-d68b-41a9-ac5b-61fc73b8be1d for instance 840693fa-71a3-4a35-8979-596bfcc1aa86 on hv-cinder-84212 May 24 14:02:12.484299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-da643976-9be3-4cb2-97b8-1b06673d21af req-684326ca-932a-4ec5-b541-52726f407588 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048200 May 24 14:02:12.485254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 274/550] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:12.558089 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:12.568132 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-43e57158-0df2-42d7-b263-2a5b2735787e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 200 len: 1327 microversion: 2.1 time: 0.112953 May 24 14:02:12.569561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 277/551] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:12 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:12.779119 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:12.779958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:12.787226 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:12.787764 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:12.788582 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:12.789020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:12.937060 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:12.946225 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d9383472-e1ac-4e23-ad1d-dd1ac1d8b80e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.171217 May 24 14:02:12.957147 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 275/552] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:12 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:13.584707 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:13.588049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:13.594365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:13.594978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:13.595946 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:13.596443 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:13.612041 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 HTTP/1.1 May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:02:13.613945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:02:13.615221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '840693fa-71a3-4a35-8979-596bfcc1aa86'} May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:02:13.616125 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:02:13.617341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:13.618400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:02:13.618400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-df0640d1-bcae-4509-99a1-3bf29706def4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 404 len: 111 microversion: 2.1 time: 0.034694 May 24 14:02:13.618400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 278/553] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:13 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 14:02:13.624877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fd64bebf-fbec-4755-9805-e70bd16a2831 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '.version_select at 0x7f33b58f2790>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:13.655633 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fd64bebf-fbec-4755-9805-e70bd16a2831 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700931574" status: 202 len: 0 microversion: 2.1 time: 0.034163 May 24 14:02:13.661097 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 276/554] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 24 14:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700931574 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:02:13.964064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:13.964674 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:13.977753 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:13.978228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:13.979014 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:13.979449 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:14.196459 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:14.203794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-612b87a7-fa1a-4b5a-b959-dae6938b67e1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.243647 May 24 14:02:14.204900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 279/555] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:13 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:14.432685 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:14.433185 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:14.440428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:14.440877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:14.441637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:14.442077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:14.522293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lazy-loading 'services' on Instance uuid 9302a225-a5b2-456b-97ef-a6c329608645 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:02:14.600398 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:14.634103 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-88a126d3-e97b-43d6-95e7-64a185e3b994 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments/d11144b6-a1df-4f35-a775-19c3cfded00c" status: 202 len: 0 microversion: 2.1 time: 0.205244 May 24 14:02:14.634691 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 277/556] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:02:14 2022] DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments/d11144b6-a1df-4f35-a775-19c3cfded00c => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:02:14.643610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:14.644771 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:14.646810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:14.647512 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:14.654796 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:14.655383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:14.656191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:14.656630 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:14.685794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cf08b9a9-6519-44a5-972d-418e975dd792 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 May 24 14:02:14.686340 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 280/557] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:14 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:14.890324 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-79702c63-e759-41d5-91bc-040901b8fb1b req-7a5bfcb7-2c02-4f53-8c9a-85adbf851b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718e90d7-f726-442e-b00a-5289fb2558de", "name": "network-vif-plugged", "status": "completed", "tag": "992b9bb4-a542-4387-82ba-0758b4b5ebb0"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:14.898760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-79702c63-e759-41d5-91bc-040901b8fb1b req-7a5bfcb7-2c02-4f53-8c9a-85adbf851b8a service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:14.899584 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-79702c63-e759-41d5-91bc-040901b8fb1b req-7a5bfcb7-2c02-4f53-8c9a-85adbf851b8a service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:14.910436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-79702c63-e759-41d5-91bc-040901b8fb1b req-7a5bfcb7-2c02-4f53-8c9a-85adbf851b8a service nova] Creating event network-vif-plugged:992b9bb4-a542-4387-82ba-0758b4b5ebb0 for instance 718e90d7-f726-442e-b00a-5289fb2558de on hv-cinder-84212 May 24 14:02:14.915143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-79702c63-e759-41d5-91bc-040901b8fb1b req-7a5bfcb7-2c02-4f53-8c9a-85adbf851b8a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029158 May 24 14:02:14.915729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 278/558] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:15.222521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:15.223091 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:15.229184 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:15.229635 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:15.230401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:15.230837 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:15.428128 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:15.431491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:15.436387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f35d9be5-4192-44b9-8142-3a13370c8036 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.218699 May 24 14:02:15.438158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 281/559] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:15 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:15.699137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:15.700173 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:15.706443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:15.706892 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:15.707651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:15.708117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:15.737822 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-50afb1dd-8cdf-4780-a5f8-b48f2014c2ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 May 24 14:02:15.738386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 279/560] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:15 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:16.455951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:16.456609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:16.463401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.463871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.464633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.465066 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.592560 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:16.600652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3f32c037-b4e8-459a-9137-081e0b4cc11d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1265 microversion: 2.1 time: 0.150087 May 24 14:02:16.601226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 282/561] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:16 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:16.749459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:16.750389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:16.757400 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.757856 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.758628 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.759071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.787202 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0c2ca4c7-1382-40c1-bffe-9df59d4534f0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041661 May 24 14:02:16.787759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 280/562] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:16 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:02:16.847201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:16.847700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:16.853727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.854182 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.854939 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.855375 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.880733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:02:16.952942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ef356adf-79d0-493c-835d-151bc3bd91ba tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 204 len: 0 microversion: 2.1 time: 0.109542 May 24 14:02:16.953504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 283/563] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:02:16 2022] DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:02:16.962379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:16.962988 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:16.968914 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.969362 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:16.970148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:16.970632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:17.098152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:17.101682 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:17.112144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4117ae12-31c0-46c4-a68c-b24d0fbe787b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1680 microversion: 2.1 time: 0.153458 May 24 14:02:17.112835 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 281/564] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:16 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:17.617218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:17.617912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:17.624198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:17.624644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:17.625415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:17.625848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:17.757700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:17.765213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d2a35c23-bc1e-46e4-9776-77a14b4c9f5b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1452 microversion: 2.1 time: 0.152163 May 24 14:02:17.765708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 284/565] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:17 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:02:17.782749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:17.783492 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:17.790598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:17.791238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:17.792016 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:17.792450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:17.924817 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:17.932283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0c3796d9-2511-4941-81f3-ceb48643fb1e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1452 microversion: 2.1 time: 0.154217 May 24 14:02:17.932862 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 282/566] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:17 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:18.130852 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:18.131459 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:18.137376 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:18.137821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:18.138574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:18.139000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:18.276124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:18.285503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-96399338-d4bc-4e33-8514-58a450e54acc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1680 microversion: 2.1 time: 0.159422 May 24 14:02:18.286075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 285/567] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:18 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:19.304588 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:19.305950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:19.316709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:19.317470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:19.318712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:19.319362 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:19.385494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-310a2778-4bea-48ef-88d7-e9b67afb8335 req-1dc14b3f-d5c4-4b05-8f6b-8d8494d8d0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9302a225-a5b2-456b-97ef-a6c329608645", "name": "network-vif-deleted", "tag": "52d23d1f-444b-41aa-8726-0248ab97db05"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:19.437441 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-310a2778-4bea-48ef-88d7-e9b67afb8335 req-1dc14b3f-d5c4-4b05-8f6b-8d8494d8d0ea service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:19.438086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-310a2778-4bea-48ef-88d7-e9b67afb8335 req-1dc14b3f-d5c4-4b05-8f6b-8d8494d8d0ea service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:19.450908 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:19.463867 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bd9bf13d-896c-4387-a920-9631a1c90620 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 200 len: 1613 microversion: 2.1 time: 0.164733 May 24 14:02:19.465581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 283/568] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:19 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:19.466740 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-310a2778-4bea-48ef-88d7-e9b67afb8335 req-1dc14b3f-d5c4-4b05-8f6b-8d8494d8d0ea service nova] Creating event network-vif-deleted:52d23d1f-444b-41aa-8726-0248ab97db05 for instance 9302a225-a5b2-456b-97ef-a6c329608645 on hv-cinder-84212 May 24 14:02:19.479189 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-310a2778-4bea-48ef-88d7-e9b67afb8335 req-1dc14b3f-d5c4-4b05-8f6b-8d8494d8d0ea service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103220 May 24 14:02:19.480369 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 286/569] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:19.971356 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7a9e24d6-166f-4d2a-91a5-62373b9e3867 req-b13e4eb6-a51b-4ae0-b622-481ef94b972a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718e90d7-f726-442e-b00a-5289fb2558de", "tag": "992b9bb4-a542-4387-82ba-0758b4b5ebb0"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:19.979953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7a9e24d6-166f-4d2a-91a5-62373b9e3867 req-b13e4eb6-a51b-4ae0-b622-481ef94b972a service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:19.980404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7a9e24d6-166f-4d2a-91a5-62373b9e3867 req-b13e4eb6-a51b-4ae0-b622-481ef94b972a service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:19.992680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7a9e24d6-166f-4d2a-91a5-62373b9e3867 req-b13e4eb6-a51b-4ae0-b622-481ef94b972a service nova] Creating event network-changed:992b9bb4-a542-4387-82ba-0758b4b5ebb0 for instance 718e90d7-f726-442e-b00a-5289fb2558de on hv-cinder-84212 May 24 14:02:19.997747 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7a9e24d6-166f-4d2a-91a5-62373b9e3867 req-b13e4eb6-a51b-4ae0-b622-481ef94b972a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030115 May 24 14:02:19.998344 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 284/570] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:20.484313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:20.485632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:20.492790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:20.493482 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:20.494677 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:20.495273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:20.510228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 HTTP/1.1 May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:02:20.512090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:02:20.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '9302a225-a5b2-456b-97ef-a6c329608645'} May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:02:20.514049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:02:20.515174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:02:20.516315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:02:20.516315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d750e056-7aed-4d58-a726-eced24eba780 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 404 len: 111 microversion: 2.1 time: 0.034731 May 24 14:02:20.516315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 287/571] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:20 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:02:20.523776 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8be9ec08-eebe-4b59-8a14-d26fa3b5c70f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '.version_select at 0x7f33b57d9e50>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:20.544218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8be9ec08-eebe-4b59-8a14-d26fa3b5c70f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-47875742" status: 202 len: 0 microversion: 2.1 time: 0.025170 May 24 14:02:20.545051 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 285/572] 10.222.0.24 () {58 vars in 1214 bytes} [Tue May 24 14:02:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-47875742 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:02:21.204232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b3469e94-0a8a-4f11-a5fb-32d53a85cf2b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: .version_select at 0x7f33b58fa280>, body: {"keypair": {"name": "tempest-keypair-441942616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNguAzxlDWWHY/3qTF0EBvqEnzSCIqpGVs3x2A0RF5Ckx1VTu+Kc4Wkj05TibnPJ4BJeLx2yy7erxKV1VDhiNRr55YJYaxOXC1rDOdAm3MVIltD6jVYe+iYDDiakmnsBPA=="}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:21.218329 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-b3469e94-0a8a-4f11-a5fb-32d53a85cf2b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:02:21.222979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-b3469e94-0a8a-4f11-a5fb-32d53a85cf2b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:02:21.244799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b3469e94-0a8a-4f11-a5fb-32d53a85cf2b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044600 May 24 14:02:21.245386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 288/573] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:02:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:22.467295 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1266967249", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e5782d9-5791-4763-85b4-bfd8289d9060"}], "security_groups": [{"name": "tempest-securitygroup--1767110219"}], "key_name": "tempest-keypair-441942616", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:22.576093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] validate_networks() for [('2e5782d9-5791-4763-85b4-bfd8289d9060', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:02:22.977836 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:02:22.978288 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:02:22.978759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:02:22.979163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:02:22.979595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:02:22.989154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:22.989597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:22.990388 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:22.991230 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:23.008115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:02:23.011984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:02:23.023043 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:02:23.025388 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:02:23.072455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fba55e9f-bd6e-41e9-be9c-959aa046678e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609932 May 24 14:02:23.073099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 286/574] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:02:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:02:23.083346 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6e6e3eb3-e993-4c1d-861b-50c3cdbac7c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:23.083980 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6e6e3eb3-e993-4c1d-861b-50c3cdbac7c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:23.139745 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6e6e3eb3-e993-4c1d-861b-50c3cdbac7c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:23.149237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6e6e3eb3-e993-4c1d-861b-50c3cdbac7c3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1241 microversion: 2.1 time: 0.069793 May 24 14:02:23.150028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 289/575] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:23 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:24.165365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:24.165974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:24.172892 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:24.173341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:24.174093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:24.175042 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:24.238689 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:24.246917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f05ba306-af54-45c7-ad3c-72e6a36fcbe8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1299 microversion: 2.1 time: 0.085353 May 24 14:02:24.247497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 287/576] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:24 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:25.264894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:25.265531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:25.273720 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:25.274278 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:25.275127 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:25.275618 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:25.462825 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-bbd06f8a-870a-4282-9cdf-f9e7bae06dc7 req-34583367-91c2-4a97-968d-176b0ba2c572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc2ee53-7340-4ef8-9fde-e631f1123d1b", "tag": "c81091ce-82fb-4359-8463-aeda233204d1"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:25.473910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-bbd06f8a-870a-4282-9cdf-f9e7bae06dc7 req-34583367-91c2-4a97-968d-176b0ba2c572 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:25.474771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-bbd06f8a-870a-4282-9cdf-f9e7bae06dc7 req-34583367-91c2-4a97-968d-176b0ba2c572 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:25.487596 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-bbd06f8a-870a-4282-9cdf-f9e7bae06dc7 req-34583367-91c2-4a97-968d-176b0ba2c572 service nova] Creating event network-changed:c81091ce-82fb-4359-8463-aeda233204d1 for instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b on hv-cinder-84212 May 24 14:02:25.494309 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-bbd06f8a-870a-4282-9cdf-f9e7bae06dc7 req-34583367-91c2-4a97-968d-176b0ba2c572 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036654 May 24 14:02:25.495269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 288/577] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:02:25.548974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:25.557254 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-eb338bec-ca21-4f29-9c0b-8db37b34d4c5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.296480 May 24 14:02:25.557832 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 290/578] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:25 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:26.575354 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:26.576088 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:26.583024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:26.583484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:26.584296 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:26.584731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:26.711251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:26.718720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9cb39e5e-2206-468c-991b-bba148545ae9 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.147973 May 24 14:02:26.719291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 289/579] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:26 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:27.736306 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:27.737494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:27.743936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:27.744391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:27.745146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:27.745593 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:27.869749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:27.877174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6af85ecd-586a-4b10-872f-5edb1ef19e48 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.144977 May 24 14:02:27.877768 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 291/580] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:27 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:28.894069 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:28.895318 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:28.902044 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:28.902504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:28.903276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:28.903708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:29.045968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:29.054310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ef4f8651-4907-4928-920e-1d9396e17212 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.164245 May 24 14:02:29.054887 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 290/581] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:28 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:30.071171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:30.071781 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:30.073759 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:30.079274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:30.079724 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:30.081298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:30.081813 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:30.209835 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:30.217156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-43f15f7d-78ae-4842-8cc6-1f1c42df6dde tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.149850 May 24 14:02:30.217726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 292/582] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:30 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:30.934899 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-d2374069-c4b7-43da-b0cf-75474d114d45 req-ab028fb5-a7ef-4a06-9e52-5861daae982b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc2ee53-7340-4ef8-9fde-e631f1123d1b", "name": "network-vif-plugged", "status": "completed", "tag": "c81091ce-82fb-4359-8463-aeda233204d1"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:30.938901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:30.944762 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d2374069-c4b7-43da-b0cf-75474d114d45 req-ab028fb5-a7ef-4a06-9e52-5861daae982b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:30.945215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d2374069-c4b7-43da-b0cf-75474d114d45 req-ab028fb5-a7ef-4a06-9e52-5861daae982b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:30.957497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-d2374069-c4b7-43da-b0cf-75474d114d45 req-ab028fb5-a7ef-4a06-9e52-5861daae982b service nova] Creating event network-vif-plugged:c81091ce-82fb-4359-8463-aeda233204d1 for instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b on hv-cinder-84212 May 24 14:02:30.962420 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-d2374069-c4b7-43da-b0cf-75474d114d45 req-ab028fb5-a7ef-4a06-9e52-5861daae982b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 May 24 14:02:30.963032 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 291/583] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:31.234165 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:31.234807 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:31.240843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:31.241290 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:31.242044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:31.242478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:31.367589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:31.375228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-922d8fa0-d2d2-4843-9afe-f75e2f3001c8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.144904 May 24 14:02:31.375788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 293/584] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:31 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:32.394553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:32.395247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:32.402419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:32.402862 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:32.403623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:32.404091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:32.532760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:32.540763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f80e36c5-7f0a-4244-ac03-e0e3400ccfd4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1367 microversion: 2.1 time: 0.152065 May 24 14:02:32.541335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 292/585] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:32 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:33.557619 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:33.558211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:33.560066 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:33.565789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:33.566235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:33.567001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:33.567430 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:33.700442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:33.707981 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-77719b78-085d-49e0-b7d0-f2f66282650e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1557 microversion: 2.1 time: 0.154175 May 24 14:02:33.708544 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 294/586] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:33 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:33.724397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:33.724898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:33.726807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:33.727665 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:33.734144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:33.734595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:33.735356 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:33.735792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:33.812243 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8e36c847-fd38-4358-8447-eefa801a8ac5 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092136 May 24 14:02:33.812872 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 293/587] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 14:02:33 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:34.725043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-16242d67-fdd7-4d7d-92b1-53853bcee264 req-f7683e08-1a10-40a2-8db8-c28ed79386c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc2ee53-7340-4ef8-9fde-e631f1123d1b", "tag": "c81091ce-82fb-4359-8463-aeda233204d1"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:34.733051 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-16242d67-fdd7-4d7d-92b1-53853bcee264 req-f7683e08-1a10-40a2-8db8-c28ed79386c8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:34.733494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-16242d67-fdd7-4d7d-92b1-53853bcee264 req-f7683e08-1a10-40a2-8db8-c28ed79386c8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:34.746048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-16242d67-fdd7-4d7d-92b1-53853bcee264 req-f7683e08-1a10-40a2-8db8-c28ed79386c8 service nova] Creating event network-changed:c81091ce-82fb-4359-8463-aeda233204d1 for instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b on hv-cinder-84212 May 24 14:02:34.755059 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-16242d67-fdd7-4d7d-92b1-53853bcee264 req-f7683e08-1a10-40a2-8db8-c28ed79386c8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 May 24 14:02:34.755653 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 295/588] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:37.713759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:37.714286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:37.720258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:37.720827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:37.721587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:37.722022 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:37.750441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-752fa67a-c67f-429e-9359-0d352d7e6591 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments/8d1e7536-d6f4-455f-8cbb-f9e5a219270b" status: 200 len: 194 microversion: 2.20 time: 0.139671 May 24 14:02:37.751000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 294/589] 10.222.0.24 () {60 vars in 1453 bytes} [Tue May 24 14:02:37 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments/8d1e7536-d6f4-455f-8cbb-f9e5a219270b => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 14:02:37.812952 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:37.813532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:37.820259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:37.820705 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:37.821459 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:37.821891 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:37.943727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lazy-loading 'services' on Instance uuid 7359d8e4-b8a7-4219-903d-71ea9f7a9292 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:02:38.054597 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-67e4b5e7-353e-4c11-bcc7-3a6cf0917916 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments/8d1e7536-d6f4-455f-8cbb-f9e5a219270b" status: 202 len: 0 microversion: 2.20 time: 0.245837 May 24 14:02:38.055191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 296/590] 10.222.0.24 () {60 vars in 1456 bytes} [Tue May 24 14:02:37 2022] DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments/8d1e7536-d6f4-455f-8cbb-f9e5a219270b => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 14:02:38.063512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:38.064741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:38.070827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:38.071304 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:38.072375 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:38.072936 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:38.105640 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a3deefe9-77e1-4d4f-ac63-ffbf44844744 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046064 May 24 14:02:38.106214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 295/591] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 24 14:02:38 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 14:02:39.118097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:39.119345 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:39.125516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:39.125959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:39.127213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:39.127644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:39.156000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-53cb7008-c1aa-411f-96f3-dfcdb9fc071b tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042207 May 24 14:02:39.156473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 297/592] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 24 14:02:39 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:39.214015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:39.214587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:39.221099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:39.221552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:39.222317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:39.222756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:39.247528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:02:39.319452 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4af7c392-a2dd-414e-988b-4b8b0bd54a73 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 204 len: 0 microversion: 2.20 time: 0.108845 May 24 14:02:39.320077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 296/593] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 24 14:02:39 2022] DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 14:02:39.328833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:39.329444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:39.336001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:39.336447 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:39.337204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:39.337637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:39.472444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:39.480455 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:39.482012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:39.483171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ee489577-8f6f-4c00-b4ed-8e1c24ca2265 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.158210 May 24 14:02:39.483738 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 298/594] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:39 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:40.502862 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:40.503557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:40.510040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:40.510480 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:40.511239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:40.511664 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:40.640126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:40.648763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:40.650284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:40.651463 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-238e8596-8665-4fe5-97cb-4bfe76a93b3f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.153351 May 24 14:02:40.652052 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 297/595] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:40 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:41.670834 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:41.671486 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:41.678389 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:41.678832 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:41.679608 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:41.680073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:41.826230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:41.837401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:41.838971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:41.840232 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5e13538f-1629-44dd-bb46-6a9c641eed2d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1720 microversion: 2.20 time: 0.173589 May 24 14:02:41.840799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 299/596] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:41 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:42.545398 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-c6f0a1b9-d38a-49f8-9bc5-364c2b3c9ca9 req-816d75a4-4f4e-44b3-8bc5-a4aba1e71867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7359d8e4-b8a7-4219-903d-71ea9f7a9292", "name": "network-vif-deleted", "tag": "71391636-ab24-466d-8141-08c93e61241a"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:42.556182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c6f0a1b9-d38a-49f8-9bc5-364c2b3c9ca9 req-816d75a4-4f4e-44b3-8bc5-a4aba1e71867 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:42.556669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c6f0a1b9-d38a-49f8-9bc5-364c2b3c9ca9 req-816d75a4-4f4e-44b3-8bc5-a4aba1e71867 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:42.569496 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-c6f0a1b9-d38a-49f8-9bc5-364c2b3c9ca9 req-816d75a4-4f4e-44b3-8bc5-a4aba1e71867 service nova] Creating event network-vif-deleted:71391636-ab24-466d-8141-08c93e61241a for instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 on hv-cinder-84212 May 24 14:02:42.574709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-c6f0a1b9-d38a-49f8-9bc5-364c2b3c9ca9 req-816d75a4-4f4e-44b3-8bc5-a4aba1e71867 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 May 24 14:02:42.578441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 298/597] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:42.862628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:42.863156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:42.869375 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:42.869816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:42.870569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:42.871001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:42.874978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:42.904672 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:42.905115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:42.905554 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lazy-loading 'fault' on Instance uuid 7359d8e4-b8a7-4219-903d-71ea9f7a9292 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:02:42.952313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:42.960714 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:42.962246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:42.963516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-303b1c48-b261-4965-8a41-a607fab7d47e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 200 len: 1370 microversion: 2.20 time: 0.105234 May 24 14:02:42.974138 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 300/598] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:42 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 1370 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:43.982827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:43.983526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:43.989742 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:43.990186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:43.990947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:43.991383 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:44.004955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] HTTP exception thrown: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Request method failure captured: May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 HTTP/1.1 May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOQt3Cu3yq_7gXtJJzsSqHqvixRlaEzF2Ha6WExNyXBysAzBwWlCh8C88mfjVv0eyvBvWcFDveUX77oR8ozOqhmeAq8dXxOK-ZRhWpX2l8zupnT2WGc_-n3LutLm7-ftL9Oh4LFIolhLxdygM-UyadeGHiBCNIM9X23sD-5tiTvgu4k May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:02:44.006549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: b3560616f4ec496f816602f9c73b69ef May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:02:44.008244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '7359d8e4-b8a7-4219-903d-71ea9f7a9292'} May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:02:44.009382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:02:44.010859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:44.012330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Returning 404 to user: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:02:44.012330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5c8d1c5c-63a9-49c7-bdbd-05440656bd1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 404 len: 111 microversion: 2.20 time: 0.029929 May 24 14:02:44.012330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 299/599] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:43 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 14:02:44.016754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-92f06262-fca3-4b3f-a28b-2cc4edd3ba0f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '.version_select at 0x7f33b580e940>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:44.039885 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-92f06262-fca3-4b3f-a28b-2cc4edd3ba0f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123001339" status: 204 len: 0 microversion: 2.20 time: 0.026769 May 24 14:02:44.040470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 301/600] 10.222.0.24 () {60 vars in 1258 bytes} [Tue May 24 14:02:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123001339 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 14:02:44.662472 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-41c9374b-c808-420d-b9bb-68bf685c5eb1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'create', calling method: .version_select at 0x7f33b59289d0>, body: {"keypair": {"name": "tempest-keypair-1363967137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh/UKERbX4CDAOA6uzZMuLTt6hypx/ZE1f9hl5e6mtzzTIeeT1FlN3E9cZbqDdCMmCXOFNk7VYvD3BJ+auexoTq5i2/fERScotwRuE32YvVppThGnJtBXeNFuJdiFEk4g=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:44.679383 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-41c9374b-c808-420d-b9bb-68bf685c5eb1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:02:44.683196 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-41c9374b-c808-420d-b9bb-68bf685c5eb1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for user b3560616f4ec496f816602f9c73b69ef and project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:02:44.705299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-41c9374b-c808-420d-b9bb-68bf685c5eb1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048001 May 24 14:02:44.705902 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 300/601] 10.222.0.24 () {62 vars in 1199 bytes} [Tue May 24 14:02:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 14:02:45.924898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-694442896", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18065f5d-f31e-4fd3-b029-c409167bb83c"}], "security_groups": [{"name": "tempest-securitygroup--1835478273"}], "key_name": "tempest-keypair-1363967137", "user_data": "}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:46.023221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] validate_networks() for [('18065f5d-f31e-4fd3-b029-c409167bb83c', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:02:46.378758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:02:46.379124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:02:46.379600 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:02:46.380045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:02:46.380461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:02:46.389169 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:46.389618 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:46.390422 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:46.390860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:46.408117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:02:46.412052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Getting quotas for user b3560616f4ec496f816602f9c73b69ef and project d3ebc40e12384ce4bb168690cfd5a27a. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:02:46.422837 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:02:46.425275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:02:46.473772 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f6846fbf-dc66-4b09-b523-20931bea6394 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.553809 May 24 14:02:46.474426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 302/602] 10.222.0.24 () {62 vars in 1187 bytes} [Tue May 24 14:02:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 14:02:46.485419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-12a61a71-5802-4fd0-9efc-7363ca27ec7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:46.486412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-12a61a71-5802-4fd0-9efc-7363ca27ec7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:46.545538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-12a61a71-5802-4fd0-9efc-7363ca27ec7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:46.553258 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-12a61a71-5802-4fd0-9efc-7363ca27ec7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:46.554816 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-12a61a71-5802-4fd0-9efc-7363ca27ec7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:46.555956 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-12a61a71-5802-4fd0-9efc-7363ca27ec7c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1281 microversion: 2.20 time: 0.074940 May 24 14:02:46.556515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 301/603] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:46 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:47.574524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:47.575240 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:47.582360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:47.582818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:47.583730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:47.584241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:47.646427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:47.655020 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:47.656590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:47.657920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c6cec94a-be95-427c-b089-abe7c329d497 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1339 microversion: 2.20 time: 0.087227 May 24 14:02:47.658703 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 303/604] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:47 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:48.674747 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:48.675777 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:48.676411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:48.676697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:48.682871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.683320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.684347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.684779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.686525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.687037 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.688034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.688598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.697066 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:48.811029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lazy-loading 'services' on Instance uuid 9efba3b6-0b80-48c5-ac89-0db944e2ac8f {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:02:48.850114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:48.859572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:48.861894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:48.863321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ab30a75a-7eed-4d9f-886f-ecf59237c998 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.192008 May 24 14:02:48.864470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 304/605] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:48 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:48.876565 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-a8b5f44d-0858-44d7-9935-9487068bbfcb req-ecfd8fea-1b9c-4c48-9f16-f2bdeef66f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:48.886049 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-a8b5f44d-0858-44d7-9935-9487068bbfcb req-ecfd8fea-1b9c-4c48-9f16-f2bdeef66f94 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.886245 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-a8b5f44d-0858-44d7-9935-9487068bbfcb req-ecfd8fea-1b9c-4c48-9f16-f2bdeef66f94 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.900309 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-a8b5f44d-0858-44d7-9935-9487068bbfcb req-ecfd8fea-1b9c-4c48-9f16-f2bdeef66f94 service nova] Creating event network-changed:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:02:48.901128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-252f7537-cac1-468a-8fda-0399792ad3e9 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments/aff80817-6ad4-46a8-bf70-1c8faec2d041" status: 202 len: 0 microversion: 2.1 time: 0.232790 May 24 14:02:48.905059 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 302/606] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:02:48 2022] DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments/aff80817-6ad4-46a8-bf70-1c8faec2d041 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:02:48.905332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-a8b5f44d-0858-44d7-9935-9487068bbfcb req-ecfd8fea-1b9c-4c48-9f16-f2bdeef66f94 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039476 May 24 14:02:48.910950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:48.912612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:48.917067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 305/607] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:48.920895 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.921550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.924078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:48.924542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:48.965805 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3f61a364-9952-49bb-87f6-c096f98cad82 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059290 May 24 14:02:48.967907 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 303/608] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:48 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:49.882223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:49.882912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:49.889239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:49.889684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:49.890446 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:49.890876 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:49.978547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:49.979569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:49.986577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:49.986961 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:49.987719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:49.988175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:50.018141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-393a9f21-29a2-4910-abef-461946bdd71b tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043501 May 24 14:02:50.018709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 304/609] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:49 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:02:50.020029 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:50.028112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:50.029641 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:50.030740 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-122efb91-9f10-4410-8e58-b077020f617c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.152772 May 24 14:02:50.031291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 306/610] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:49 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:51.029064 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:51.030000 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:51.037070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:51.037513 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:51.038264 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:51.038696 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:51.047053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:51.047682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:51.054233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:51.054671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:51.055427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:51.056054 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:51.067931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5d77cb6a-fa94-4e3f-958b-9d640f3ad59c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042725 May 24 14:02:51.068490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 305/611] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:51 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:51.185818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:51.193928 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:51.195430 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:51.196543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-477191ca-6a04-4f48-83a2-9b4f3849a785 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.153274 May 24 14:02:51.197095 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 307/612] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:51 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:52.078632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:52.079570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:52.086071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:52.086524 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:52.087290 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:52.087729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:52.116774 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-530b08df-86ba-47fc-96ab-f687b955fb46 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 May 24 14:02:52.117321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 306/613] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:52 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:52.214456 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:52.214998 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:52.221048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:52.221495 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:52.222249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:52.222681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:52.351178 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:52.359012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:52.361180 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:52.362263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f57d5a3e-9ec9-4bdc-b24d-3d6e0b7eea2e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.151774 May 24 14:02:52.362822 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 308/614] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:52 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:53.128941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:53.130027 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:53.136215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.136660 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.137412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.137837 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.165656 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2c653d8e-997f-4ac9-b1a6-86bdfe8b64f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040982 May 24 14:02:53.166205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 307/615] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:02:53 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:02:53.240292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:53.240811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:53.246920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.247373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.248157 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.248591 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.272294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:02:53.346035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bccf9272-8e4c-4613-bcf0-05bf6385a85a tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 204 len: 0 microversion: 2.1 time: 0.108936 May 24 14:02:53.346605 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 309/616] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:02:53 2022] DELETE /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:02:53.354646 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:53.355250 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:53.362088 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.362532 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.363284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.363718 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.380437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:53.381158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:53.387443 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.387937 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.388700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:53.389161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:53.499964 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:53.507812 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-73726ea8-3bb2-4168-8ad1-a67b4cc97855 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1690 microversion: 2.1 time: 0.156860 May 24 14:02:53.518356 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 308/617] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:53 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:53.539611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:53.547556 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:53.549117 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:53.550204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f4657e8f-ba82-4fb6-a12b-9d3cac6a0dd4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.174012 May 24 14:02:53.550767 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 310/618] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:53 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:54.525471 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:54.526117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:54.533112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:54.533560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:54.534321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:54.534760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:54.568155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:54.568764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:54.574917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:54.575371 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:54.576176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:54.576615 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:54.664689 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:54.672228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-54a11592-03a9-4de3-bc9f-402e58b1d53d tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1690 microversion: 2.1 time: 0.150586 May 24 14:02:54.673351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 309/619] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:54 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:54.708255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:54.716220 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:54.717741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:54.718828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a1a7e758-d77b-42a5-ad71-213e9454fae5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.154522 May 24 14:02:54.719967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 311/620] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:54 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:55.054842 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-163ae230-3a79-438b-809d-79a0f830beb1 req-bb2d656f-25af-407d-a8e0-b9257e0dc02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "name": "network-vif-plugged", "status": "completed", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:55.065414 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-163ae230-3a79-438b-809d-79a0f830beb1 req-bb2d656f-25af-407d-a8e0-b9257e0dc02e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:55.066205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-163ae230-3a79-438b-809d-79a0f830beb1 req-bb2d656f-25af-407d-a8e0-b9257e0dc02e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:55.086581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-163ae230-3a79-438b-809d-79a0f830beb1 req-bb2d656f-25af-407d-a8e0-b9257e0dc02e service nova] Creating event network-vif-plugged:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:02:55.095554 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-163ae230-3a79-438b-809d-79a0f830beb1 req-bb2d656f-25af-407d-a8e0-b9257e0dc02e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044054 May 24 14:02:55.096844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 310/621] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:55.690636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:55.691153 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:55.697207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:55.697645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:55.698391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:55.698816 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:55.738971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:55.739706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:55.746352 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:55.746801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:55.747578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:55.748046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:55.827498 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:55.835614 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-074c41a3-1dbf-48a8-a573-e88a01922161 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1690 microversion: 2.1 time: 0.149603 May 24 14:02:55.836239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 312/622] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:55 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:55.877844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:55.885707 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:55.887233 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:55.888374 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7c986dca-7e13-4a34-bb39-035334416fd9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.154866 May 24 14:02:55.889104 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 311/623] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:55 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:56.852886 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:56.853489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:56.855412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:56.856072 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:56.861668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:56.862110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:56.862862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:56.863291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:56.906015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:56.906617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:56.909571 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:02:56.914473 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:56.914916 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:56.915680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:56.916135 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:56.996218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:57.004727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-60075dd3-96d7-4a7c-ac07-edfba3050355 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1690 microversion: 2.1 time: 0.155641 May 24 14:02:57.005434 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 313/624] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:56 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:57.049987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:57.057954 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:57.059459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:57.060580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-941f9d2a-0fa8-45c5-91c3-a1d358c8e4da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.158430 May 24 14:02:57.061136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 312/625] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:56 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:02:58.022415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:58.023022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:58.029120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:58.029570 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:58.030329 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:58.030766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:58.078733 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:58.092109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:58.099691 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:58.100151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:58.100885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:58.101332 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:58.201015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:58.209285 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2459962f-fc0d-47df-a6b4-3367b491c7f3 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 200 len: 1690 microversion: 2.1 time: 0.190741 May 24 14:02:58.209859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 314/626] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:58 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:02:58.366331 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:58.374596 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:58.376143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:58.377430 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5de790fe-221b-4d27-9d7c-24e8f7b6ef00 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1407 microversion: 2.20 time: 0.302580 May 24 14:02:58.377995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 313/627] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:58 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:58.599228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-0b0050f6-a6e9-497d-89ba-a36fb9d0a0dd req-e181e977-5b96-4d84-8d78-aec7d23007b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efba3b6-0b80-48c5-ac89-0db944e2ac8f", "name": "network-vif-deleted", "tag": "6ec58c80-6380-4300-8c4d-013be3a1d9bb"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:02:58.607806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0b0050f6-a6e9-497d-89ba-a36fb9d0a0dd req-e181e977-5b96-4d84-8d78-aec7d23007b3 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:58.608202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0b0050f6-a6e9-497d-89ba-a36fb9d0a0dd req-e181e977-5b96-4d84-8d78-aec7d23007b3 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:58.621779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-0b0050f6-a6e9-497d-89ba-a36fb9d0a0dd req-e181e977-5b96-4d84-8d78-aec7d23007b3 service nova] Creating event network-vif-deleted:6ec58c80-6380-4300-8c4d-013be3a1d9bb for instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f on hv-cinder-84212 May 24 14:02:58.627228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-0b0050f6-a6e9-497d-89ba-a36fb9d0a0dd req-e181e977-5b96-4d84-8d78-aec7d23007b3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 May 24 14:02:58.631065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 315/628] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:02:59.226361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:59.227062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 9efba3b6-0b80-48c5-ac89-0db944e2ac8f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:59.233546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:59.234068 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:59.234903 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:59.235410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:59.249695 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] HTTP exception thrown: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f could not be found. May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Request method failure captured: May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f HTTP/1.1 May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPh81quQjnD-qmdosxKbMMw-h-WryCXpaNbCqNl1mGxuZnbA1wePY8nRZkc94zTX7ff-on65-_evJ5KGEs43TvjvpPHl93PvGkREv1jt67q2qiB2Y4qHvYsNPlVE4KsMHNJqUQexrkRXstmH5S3SWH3r8FLj1FMkfJQqGtZXNI6H4A May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:02:59.251365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_54ee7d13408645e6b6517f541fe45670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 532b36f272dc432aad6faa294bd1bc6c May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f could not be found. May 24 14:02:59.253515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '9efba3b6-0b80-48c5-ac89-0db944e2ac8f'} May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f could not be found. May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:02:59.254320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f could not be found. May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f could not be found. May 24 14:02:59.255630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:02:59.256787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Returning 404 to user: Instance 9efba3b6-0b80-48c5-ac89-0db944e2ac8f could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:02:59.256787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0aafbc7b-b773-46ca-bdce-29c82ca87aaa tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f" status: 404 len: 111 microversion: 2.1 time: 0.030868 May 24 14:02:59.256787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 314/629] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:02:59 2022] GET /compute/v2.1/servers/9efba3b6-0b80-48c5-ac89-0db944e2ac8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:02:59.262864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c1ee0704-df50-4af8-9b65-4b01002be42c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '.version_select at 0x7f33b58fa430>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:59.283016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c1ee0704-df50-4af8-9b65-4b01002be42c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410042429" status: 202 len: 0 microversion: 2.1 time: 0.024246 May 24 14:02:59.283777 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 316/630] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 24 14:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410042429 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:02:59.396576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:59.397401 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:59.404111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:59.404888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:59.405678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:59.406250 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:59.948052 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:59.956999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:59.958446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:02:59.959709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-62aee44d-50aa-4228-8ef7-42f8d02893b1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1598 microversion: 2.20 time: 0.567879 May 24 14:02:59.960423 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 315/631] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:02:59 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1598 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:02:59.977259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:02:59.977869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:02:59.984233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:59.984678 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:02:59.985435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:02:59.985863 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:00.077618 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-485ca289-25fb-4d4e-b79d-e8acefb28f83 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104179 May 24 14:03:00.078535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 317/632] 10.222.0.24 () {60 vars in 1315 bytes} [Tue May 24 14:02:59 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 14:03:00.999078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-9b09d623-5f1f-4e08-90de-2be3b549f3c9 req-e7cf18da-4f1f-4042-ab2a-a20bb402b2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:03:01.007767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9b09d623-5f1f-4e08-90de-2be3b549f3c9 req-e7cf18da-4f1f-4042-ab2a-a20bb402b2de service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:01.008384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9b09d623-5f1f-4e08-90de-2be3b549f3c9 req-e7cf18da-4f1f-4042-ab2a-a20bb402b2de service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:01.019605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-9b09d623-5f1f-4e08-90de-2be3b549f3c9 req-e7cf18da-4f1f-4042-ab2a-a20bb402b2de service nova] Creating event network-changed:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:03:01.024521 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-9b09d623-5f1f-4e08-90de-2be3b549f3c9 req-e7cf18da-4f1f-4042-ab2a-a20bb402b2de service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029099 May 24 14:03:01.025517 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 316/633] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:02.496271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:02.496874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:02.498827 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:02.504739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:02.505188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:02.505957 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:02.506391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:02.533965 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:03:02.547069 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:02.610779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-de19c703-67c6-4612-afbf-c14e1e9ae4b4 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "DELETE /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 204 len: 0 microversion: 2.1 time: 0.118224 May 24 14:03:02.611401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 318/634] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:03:02 2022] DELETE /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:03:02.621392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:02.622093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:02.624026 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:02.629743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:02.630187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:02.630949 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:02.631384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:02.761116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:03:02.769174 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c17a8765-59e6-4078-be8e-c55c4c6c0b84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1508 microversion: 2.1 time: 0.152836 May 24 14:03:02.769741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 317/635] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:03:02 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:03:03.786429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:03.787625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:03.788974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-66224d28-2953-4af0-8382-65a733aa3804 req-5da56494-6b04-4e5a-b660-7385a5a1b880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f67703-35a4-40ad-a442-d8230c57ca65", "name": "network-vif-deleted", "tag": "962017d2-ce45-4701-b48a-e3e4aa4836f5"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:03:03.793825 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:03.794011 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:03.794662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:03.795114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:03.806303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-66224d28-2953-4af0-8382-65a733aa3804 req-5da56494-6b04-4e5a-b660-7385a5a1b880 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:03.807076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-66224d28-2953-4af0-8382-65a733aa3804 req-5da56494-6b04-4e5a-b660-7385a5a1b880 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:03.821565 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-66224d28-2953-4af0-8382-65a733aa3804 req-5da56494-6b04-4e5a-b660-7385a5a1b880 service nova] Creating event network-vif-deleted:962017d2-ce45-4701-b48a-e3e4aa4836f5 for instance 84f67703-35a4-40ad-a442-d8230c57ca65 on hv-cinder-84212 May 24 14:03:03.827256 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-66224d28-2953-4af0-8382-65a733aa3804 req-5da56494-6b04-4e5a-b660-7385a5a1b880 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043752 May 24 14:03:03.828120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 319/636] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:03.864355 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:03:03.872731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cb582335-07e5-4e4e-becd-de9164006c84 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 200 len: 1466 microversion: 2.1 time: 0.090130 May 24 14:03:03.873284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 318/637] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:03:03 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 1466 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:03:04.895334 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:04.895989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 84f67703-35a4-40ad-a442-d8230c57ca65] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:04.902098 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:04.902537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:04.903284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:04.903710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:04.917063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] HTTP exception thrown: Instance 84f67703-35a4-40ad-a442-d8230c57ca65 could not be found. May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Request method failure captured: May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 HTTP/1.1 May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPh81quQjnD-qmdosxKbMMw-h-WryCXpaNbCqNl1mGxuZnbA1wePY8nRZkc94zTX7ff-on65-_evJ5KGEs43TvjvpPHl93PvGkREv1jt67q2qiB2Y4qHvYsNPlVE4KsMHNJqUQexrkRXstmH5S3SWH3r8FLj1FMkfJQqGtZXNI6H4A May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:03:04.918684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_54ee7d13408645e6b6517f541fe45670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 532b36f272dc432aad6faa294bd1bc6c May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 84f67703-35a4-40ad-a442-d8230c57ca65 could not be found. May 24 14:03:04.920301 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '84f67703-35a4-40ad-a442-d8230c57ca65'} May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f67703-35a4-40ad-a442-d8230c57ca65 could not be found. May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:03:04.921470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f67703-35a4-40ad-a442-d8230c57ca65 could not be found. May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f67703-35a4-40ad-a442-d8230c57ca65 could not be found. May 24 14:03:04.922955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:04.924688 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Returning 404 to user: Instance 84f67703-35a4-40ad-a442-d8230c57ca65 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:03:04.924688 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3c86c843-8989-4acb-a7e2-3dff6541b591 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65" status: 404 len: 111 microversion: 2.1 time: 0.029582 May 24 14:03:04.924688 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 320/638] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:03:04 2022] GET /compute/v2.1/servers/84f67703-35a4-40ad-a442-d8230c57ca65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:03:04.928639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:04.929148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:04.935672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:04.936155 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:04.936923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:04.937362 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:04.964187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:03:04.981067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:05.043405 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-19d65da5-3957-4aaa-9394-eb3fe74fec6c tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 204 len: 0 microversion: 2.1 time: 0.118329 May 24 14:03:05.044131 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 319/639] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:03:04 2022] DELETE /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 14:03:05.053230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:05.053872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:05.060276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:05.060730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:05.061493 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:05.061933 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:05.195284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:03:05.202896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e77d2b60-afe6-4c1c-bb8d-a5a0237ce81f tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1521 microversion: 2.1 time: 0.154165 May 24 14:03:05.203462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 321/640] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:03:05 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:03:06.221524 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:06.222134 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:06.228767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:06.229217 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:06.229987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:06.230424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:06.326255 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532b36f272dc432aad6faa294bd1bc6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ee7d13408645e6b6517f541fe45670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:03:06.335639 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9ad77f1f-e423-46a7-8684-f1a65a536296 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 200 len: 1479 microversion: 2.1 time: 0.119056 May 24 14:03:06.336404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 320/641] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:03:06 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 1479 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:03:06.377009 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-94a3cbd4-77b1-4222-83b7-c58e95727bc5 req-c5526e39-a195-4f6b-866f-c150aabe3546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f19875e-64fa-4a59-9a45-a3d6e7ae96d6", "name": "network-vif-deleted", "tag": "b953d341-a6ef-44a5-b545-6c5db2385fb4"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:03:06.385378 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-94a3cbd4-77b1-4222-83b7-c58e95727bc5 req-c5526e39-a195-4f6b-866f-c150aabe3546 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:06.385817 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-94a3cbd4-77b1-4222-83b7-c58e95727bc5 req-c5526e39-a195-4f6b-866f-c150aabe3546 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:06.397488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-94a3cbd4-77b1-4222-83b7-c58e95727bc5 req-c5526e39-a195-4f6b-866f-c150aabe3546 service nova] Creating event network-vif-deleted:b953d341-a6ef-44a5-b545-6c5db2385fb4 for instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 on hv-cinder-84212 May 24 14:03:06.402587 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-94a3cbd4-77b1-4222-83b7-c58e95727bc5 req-c5526e39-a195-4f6b-866f-c150aabe3546 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029513 May 24 14:03:06.403397 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 322/642] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:07.354066 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:07.354671 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] [instance: 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:03:07.361701 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:07.362146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:07.362906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:03:07.363335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:03:07.376597 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] HTTP exception thrown: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 could not be found. May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Request method failure captured: May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 HTTP/1.1 May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPh81quQjnD-qmdosxKbMMw-h-WryCXpaNbCqNl1mGxuZnbA1wePY8nRZkc94zTX7ff-on65-_evJ5KGEs43TvjvpPHl93PvGkREv1jt67q2qiB2Y4qHvYsNPlVE4KsMHNJqUQexrkRXstmH5S3SWH3r8FLj1FMkfJQqGtZXNI6H4A May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:03:07.378195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_54ee7d13408645e6b6517f541fe45670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/54ee7d13408645e6b6517f541fe45670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 54ee7d13408645e6b6517f541fe45670 May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951157678 May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 532b36f272dc432aad6faa294bd1bc6c May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951157678-project May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 could not be found. May 24 14:03:07.379749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '2f19875e-64fa-4a59-9a45-a3d6e7ae96d6'} May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 could not be found. May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:03:07.380806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 could not be found. May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 could not be found. May 24 14:03:07.382238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:03:07.383587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] Returning 404 to user: Instance 2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:03:07.383587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1c2236ad-c126-4a12-aac2-3c7af5698c41 tempest-ServerRescueNegativeTestJSON-1951157678 tempest-ServerRescueNegativeTestJSON-1951157678-project] 10.222.0.24 "GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6" status: 404 len: 111 microversion: 2.1 time: 0.029401 May 24 14:03:07.383587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 321/643] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:03:07 2022] GET /compute/v2.1/servers/2f19875e-64fa-4a59-9a45-a3d6e7ae96d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:03:12.005328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d89a2f1f-47fc-4cee-a1a8-c0bac07db55e tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Action: 'create', calling method: .version_select at 0x7f33b580ee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-61219946", "metadata": {"Type": "work"}}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:03:12.284787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d89a2f1f-47fc-4cee-a1a8-c0bac07db55e tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.402535 May 24 14:03:12.285416 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 323/644] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 24 14:03:11 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 404 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 14:03:12.296099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bc031e5f-cf71-4cb9-8443-d31fa59d6d76 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Calling method '.version_select at 0x7f33baa6b040>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:12.349584 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bc031e5f-cf71-4cb9-8443-d31fa59d6d76 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726" status: 200 len: 351 microversion: 2.1 time: 0.057157 May 24 14:03:12.350151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 322/645] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:12 2022] GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:13.362285 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3de65f21-c4cf-4257-b190-c79af3a801b8 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Calling method '.version_select at 0x7f33b57a0670>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:13.409505 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3de65f21-c4cf-4257-b190-c79af3a801b8 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726" status: 200 len: 352 microversion: 2.1 time: 0.051146 May 24 14:03:13.410075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 324/646] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:13 2022] GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:13.421252 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a0fde1a7-7a6c-4e30-baed-08d91fc3f460 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Calling method '.version_select at 0x7f33baa82550>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:13.467938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a0fde1a7-7a6c-4e30-baed-08d91fc3f460 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726" status: 200 len: 352 microversion: 2.1 time: 0.050828 May 24 14:03:13.468498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 323/647] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:13 2022] GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:13.479963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-44882b15-40b9-4ff6-b8fd-3947f7ca5ccb tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Calling method '.version_select at 0x7f33b5942040>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:13.540203 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-44882b15-40b9-4ff6-b8fd-3947f7ca5ccb tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726" status: 202 len: 0 microversion: 2.1 time: 0.063970 May 24 14:03:13.540766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 325/648] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 14:03:13 2022] DELETE /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:03:13.548763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-efcce3a6-5474-46a7-82d2-25c6c78cab99 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Calling method '.version_select at 0x7f33baa598b0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:13.596748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-efcce3a6-5474-46a7-82d2-25c6c78cab99 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726" status: 200 len: 351 microversion: 2.1 time: 0.051868 May 24 14:03:13.597307 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 324/649] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:13 2022] GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:14.609320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b8cc9fdc-d2c1-4b33-9ea8-cbe0caceff33 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Calling method '.version_select at 0x7f33b57a0040>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:14.636297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-b8cc9fdc-d2c1-4b33-9ea8-cbe0caceff33 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] HTTP exception thrown: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b8cc9fdc-d2c1-4b33-9ea8-cbe0caceff33 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Request method failure captured: May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 HTTP/1.1 May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOWf3R_U63yHAw_pXVWJYbwatN4MAK0qLtKuxVqtqvpNUnGX5vb8aTlo7IUbqn63XpVnEZVjfV218aWI86yZefQ-CmxhrUJf9s_HKfGMTv5fSYJZnBM9bvb3dIaE_CiFLm1gjK7-SwfF8TB2vG5I00IbLQ3jz2iujZCjQuEIJq6gUsI May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: afb964eae6b941fc943cca8cf9c3d075 May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-VolumesGetTestJSON-790337441 May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:03:14.638303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_afb964eae6b941fc943cca8cf9c3d075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/afb964eae6b941fc943cca8cf9c3d075"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/afb964eae6b941fc943cca8cf9c3d075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/afb964eae6b941fc943cca8cf9c3d075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-VolumesGetTestJSON-790337441 May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: afb964eae6b941fc943cca8cf9c3d075 May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-VolumesGetTestJSON-790337441 May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-VolumesGetTestJSON-790337441-project May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 5f29e83de728455bac6a1227e1f2deef May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-VolumesGetTestJSON-790337441-project May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '3638e9f9-1b9f-404c-a502-1de2cdb68726'} May 24 14:03:14.639799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. (HTTP 404) (Request-ID: req-9272bb79-e06b-46b0-8d77-c4ed05841421) May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:14.640872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 14:03:14.642481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 14:03:14.643844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b8cc9fdc-d2c1-4b33-9ea8-cbe0caceff33 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] Returning 404 to user: Volume 3638e9f9-1b9f-404c-a502-1de2cdb68726 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b8cc9fdc-d2c1-4b33-9ea8-cbe0caceff33 tempest-VolumesGetTestJSON-790337441 tempest-VolumesGetTestJSON-790337441-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726" status: 404 len: 109 microversion: 2.1 time: 0.034243 May 24 14:03:14.645168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 326/650] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:14 2022] GET /compute/v2.1/os-volumes/3638e9f9-1b9f-404c-a502-1de2cdb68726 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:03:17.316567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a121cbfb-22c8-4e7d-a7ea-9450310ad84d tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33b5879790>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:17.358611 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:17.366077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a121cbfb-22c8-4e7d-a7ea-9450310ad84d tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/b5f7b112-1c7c-4de8-855b-8a2fb43d0119" status: 200 len: 351 microversion: 2.1 time: 0.054629 May 24 14:03:17.366693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 325/651] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:17 2022] GET /compute/v2.1/os-volumes/b5f7b112-1c7c-4de8-855b-8a2fb43d0119 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:18.676989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:18.677731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:18.681451 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3beca93b-9afb-4707-b122-0456ebdaa1bd tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33b580ee50>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:18.728981 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3beca93b-9afb-4707-b122-0456ebdaa1bd tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/2d4f76fb-9a65-4418-9259-3fe2a9138786" status: 200 len: 351 microversion: 2.1 time: 0.052767 May 24 14:03:18.729546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 327/652] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:18 2022] GET /compute/v2.1/os-volumes/2d4f76fb-9a65-4418-9259-3fe2a9138786 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:20.097031 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:03:20.101580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0cffb290-a419-48f3-a3a1-0d511425ab9c tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33baa82670>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.148572 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0cffb290-a419-48f3-a3a1-0d511425ab9c tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/d9c96ff3-b06c-4859-94b2-e81465ca8878" status: 200 len: 350 microversion: 2.1 time: 0.052832 May 24 14:03:20.149142 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 326/653] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes/d9c96ff3-b06c-4859-94b2-e81465ca8878 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:20.161115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-eaccb082-6199-4bad-97d3-6e42321e6a59 tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33b5807a60>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.240235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-eaccb082-6199-4bad-97d3-6e42321e6a59 tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083645 May 24 14:03:20.240931 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 328/654] 10.222.0.24 () {58 vars in 1133 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:03:20.253083 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bf620405-805e-40e3-8ce6-612fec2011ef tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33baa82dc0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.332865 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bf620405-805e-40e3-8ce6-612fec2011ef tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083434 May 24 14:03:20.333426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 327/655] 10.222.0.24 () {58 vars in 1148 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:20.346809 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-47bc970d-a665-486b-9460-c6ebb53c08dd tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33b580e3a0>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.431330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-47bc970d-a665-486b-9460-c6ebb53c08dd tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089868 May 24 14:03:20.431922 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 329/656] 10.222.0.24 () {58 vars in 1133 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:03:20.442916 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-24bd907f-bd39-4cc5-98d7-3f310e93f4ea tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33baa82160>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.525694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-24bd907f-bd39-4cc5-98d7-3f310e93f4ea tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086542 May 24 14:03:20.526253 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 328/657] 10.222.0.24 () {58 vars in 1166 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:20.538158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2086c3cd-0358-4757-b6db-26c878679b8f tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33b58fadc0>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.619936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2086c3cd-0358-4757-b6db-26c878679b8f tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085701 May 24 14:03:20.620503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 330/658] 10.222.0.24 () {58 vars in 1169 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:20.632293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-debae232-80f5-4819-b92b-1291d6f4a7f5 tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33baa6b0d0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.711973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-debae232-80f5-4819-b92b-1291d6f4a7f5 tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083249 May 24 14:03:20.712542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 329/659] 10.222.0.24 () {58 vars in 1154 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:03:20.723748 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6ed65e19-5777-45e8-b08a-da9527ea9b4c tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33b5955820>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.802586 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6ed65e19-5777-45e8-b08a-da9527ea9b4c tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082702 May 24 14:03:20.803202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 331/660] 10.222.0.24 () {58 vars in 1187 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:03:20.814578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a59f1b8c-f17e-4967-a8eb-48fd6c80036a tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] Calling method '.version_select at 0x7f33baa59040>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:03:20.894885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a59f1b8c-f17e-4967-a8eb-48fd6c80036a tempest-VolumesTestJSON-1260763443 tempest-VolumesTestJSON-1260763443-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083341 May 24 14:03:20.895582 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 330/661] 10.222.0.24 () {58 vars in 1154 bytes} [Tue May 24 14:03:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:18.988940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7dcbbd35-bcc7-4277-93f2-7febba1db1ed tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Action: 'create', calling method: .version_select at 0x7f33b57a03a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1993148995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm0k5sPZ9g22o2FAhpvGMbULKr2bAyVFh7Kb7z0tBFwF2yU3RmIG+FvgyJaGO1XRObVp0vTYoWAvv2pTk58yQihna+z+rrMV64KH4z+EmXxGzm2aMBjq/vBqjYD7e7R5w=="}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:19.004554 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-7dcbbd35-bcc7-4277-93f2-7febba1db1ed tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Getting quotas for project cbe0605c62d04bed8edf14047746e765. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:04:19.008774 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-7dcbbd35-bcc7-4277-93f2-7febba1db1ed tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Getting quotas for user 72aba3691e2e4b40b6643c8318caa9d6 and project cbe0605c62d04bed8edf14047746e765. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:04:19.031634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7dcbbd35-bcc7-4277-93f2-7febba1db1ed tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.227065 May 24 14:04:19.032269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 332/662] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:04:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:04:30.222412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:30.222910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:30.229791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:30.230239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:30.231005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:30.231438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:30.255528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8a16739c-23fa-443b-8685-4dedb409ffc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/ips" status: 200 len: 149 microversion: 2.1 time: 0.039583 May 24 14:04:30.256138 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 331/663] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 14:04:30 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:04:32.628783 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:32.629958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:32.631939 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=4 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:32.632577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:32.639129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:32.639586 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:32.640585 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:32.641345 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:39.744107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-eca7a693-ab48-4717-83bc-621705efe5e1 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.119017 May 24 14:04:39.745379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 333/664] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:04:32 2022] POST /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments => generated 194 bytes in 7121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:04:47.766999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1929663568", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1993148995", "security_groups": [{"name": "tempest-secgroup-smoke-836157596"}], "networks": [{"uuid": "ceb718dc-f4a8-4668-a280-59d30b7a2d2c"}], "block_device_mapping_v2": [{"uuid": "6578b60d-2c9c-4857-bff4-d2693e320e4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:47.775499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:47.776218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=4 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:47.884959 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] validate_networks() for [('ceb718dc-f4a8-4668-a280-59d30b7a2d2c', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:04:47.897288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:47.901666 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-14408838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-131305348", "security_groups": [{"name": "tempest-secgroup-smoke-281582916"}], "block_device_mapping_v2": [{"uuid": "24036848-8b75-4f60-9a58-ffa93d38f00f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da184706-a3cd-4a03-bf62-0c961d1fd5b4"}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:48.019989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] validate_networks() for [('da184706-a3cd-4a03-bf62-0c961d1fd5b4', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:04:48.269737 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:04:48.270401 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:04:48.270882 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:04:48.271523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:04:48.271984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:04:48.282156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.282156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.282910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.283379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.304029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Getting quotas for project cbe0605c62d04bed8edf14047746e765. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:04:48.305546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Getting quotas for user 72aba3691e2e4b40b6643c8318caa9d6 and project cbe0605c62d04bed8edf14047746e765. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:04:48.364364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:04:48.366835 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6578b60d-2c9c-4857-bff4-d2693e320e4f',volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:04:48.406385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:04:48.406839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:04:48.408032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:04:48.408448 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:04:48.408879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:04:48.417971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.418420 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.419213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.419673 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.436840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:04:48.440997 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Getting quotas for user 3acb774848a74e74a5886ee681ed205c and project 7bb15f1d3e524d67b5493cb483ee8547. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:04:48.500429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8559f1c5-b89a-4015-8806-1f64c0117967 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737481 May 24 14:04:48.501247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 332/665] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:04:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 14:04:48.506153 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:48.507406 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:48.512832 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:04:48.515002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24036848-8b75-4f60-9a58-ffa93d38f00f',volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:04:48.517055 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.517671 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.518863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.519308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.612620 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Invalid volume: volume 7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 is already attached to instances: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: POST /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments HTTP/1.1 May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 74 May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:04:48.614533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {"volumeAttachment": {"volumeId": "7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0"}} May 24 14:04:48.616036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Invalid volume: volume 7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 is already attached to instances: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': '7cc2ee53-7340-4ef8-9fde-e631f1123d1b', 'body': {'volumeAttachment': {'volumeId': '7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0'}}} May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 is already attached to instances: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:04:48.617126 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 is already attached to instances: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:04:48.618409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 is already attached to instances: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 400 to user: Invalid volume: volume 7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 is already attached to instances: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e08e24a5-fbc2-40ed-a3d7-6d1097393eed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113677 May 24 14:04:48.619650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 333/666] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:04:48 2022] POST /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 14:04:48.625645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c230d797-c358-4f97-9dc4-0d3284c826d3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:48.626264 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c230d797-c358-4f97-9dc4-0d3284c826d3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:48.677129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a887a3e4-d99d-4645-9c39-c538947dac03 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781111 May 24 14:04:48.684304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 334/667] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:04:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 14:04:48.689953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0bb37ef5-1cfd-4b36-a55c-16d76f1307a8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:48.690568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0bb37ef5-1cfd-4b36-a55c-16d76f1307a8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:48.705273 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c230d797-c358-4f97-9dc4-0d3284c826d3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:48.716040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c230d797-c358-4f97-9dc4-0d3284c826d3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1089 microversion: 2.1 time: 0.094280 May 24 14:04:48.720621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 334/668] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:48 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1089 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:48.734468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:48.734974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:48.741843 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.742323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.743112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.743556 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.752433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0bb37ef5-1cfd-4b36-a55c-16d76f1307a8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:48.759457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0bb37ef5-1cfd-4b36-a55c-16d76f1307a8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1092 microversion: 2.1 time: 0.073671 May 24 14:04:48.760300 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 335/669] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:48 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1092 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:48.860236 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lazy-loading 'services' on Instance uuid 7cc2ee53-7340-4ef8-9fde-e631f1123d1b {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:04:48.944821 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4273e9ec-3bfa-4025-932a-1297768fae22 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments/7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0" status: 202 len: 0 microversion: 2.1 time: 0.221962 May 24 14:04:48.947982 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 335/670] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:04:48 2022] DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments/7e7e7d83-c7c4-4d79-bbe9-d6edc8cdecd0 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:04:48.955022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:48.956299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:48.964040 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.964670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:48.965532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:48.966388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:49.005314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d274b473-f970-4c5e-91bb-63720e170eaa tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054389 May 24 14:04:49.005911 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 336/671] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:04:48 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:04:49.733839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:49.734451 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:49.740978 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:49.741743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:49.742617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:49.743115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:49.777206 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:49.777930 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:49.784471 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:49.785195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:49.785980 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:49.786975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:49.818708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:49.830818 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ec384239-c5bf-4ba4-a585-bf2cfb020e28 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1187 microversion: 2.1 time: 0.101355 May 24 14:04:49.831379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 336/672] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:49 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:49.860452 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:49.868409 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-21e1243a-3e23-4e24-a823-f49e02eaf62c tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1190 microversion: 2.1 time: 0.095621 May 24 14:04:49.868989 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 337/673] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:49 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:50.017484 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:50.018477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:50.024411 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.024859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.025605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.026035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.054651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-471b82ef-ceb7-4ffd-b833-b8b71413ef9f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041064 May 24 14:04:50.055460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 337/674] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:04:50 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:04:50.134934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:50.136940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:50.144463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.144915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.145695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.146130 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.172887 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:04:50.288276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f58f6ef7-848e-49d7-8b5c-331443444b4e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 204 len: 0 microversion: 2.1 time: 0.156863 May 24 14:04:50.294800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 338/675] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:04:50 2022] DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:04:50.297053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:50.297773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:50.304163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.305330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.306402 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.307151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.480605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:50.488342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9e3ea534-807c-4ff4-b894-1bd8fbeef68e tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1681 microversion: 2.1 time: 0.195028 May 24 14:04:50.488900 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 338/676] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:50 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:50.850394 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:50.851102 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:50.857152 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.857601 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.858358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.858790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.886295 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:50.886773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:50.893241 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.893686 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.894446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:50.895183 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:50.924972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:50.933112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0426e7be-2308-407e-a13d-4d8c80acf7c2 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1205 microversion: 2.1 time: 0.086401 May 24 14:04:50.933709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 339/677] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:50 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:50.956162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:50.963754 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a95302df-7eaf-43e4-b920-5eb26c2d8119 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1208 microversion: 2.1 time: 0.082014 May 24 14:04:50.964472 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 339/678] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:50 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:04:51.505099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:51.505708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:51.512300 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:51.512744 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:51.513503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:51.513935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:51.735101 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:51.746415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-00b125ff-ebd7-430a-8bff-714e2cd614c2 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1681 microversion: 2.1 time: 0.245037 May 24 14:04:51.747004 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 340/679] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:51 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:51.951014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:51.952376 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:51.959943 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:51.960643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:51.961648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:51.962315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:51.982150 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:51.983046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:52.012307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:52.019781 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:52.021446 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:52.021985 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:52.077041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:52.085171 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-331af874-6952-4726-8619-de8756e93122 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1193 microversion: 2.1 time: 0.138678 May 24 14:04:52.086293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 340/680] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:51 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:52.363977 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:52.379110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-27bbe7cf-3d7c-48df-83b3-cfddacbc77be tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1275 microversion: 2.1 time: 0.399998 May 24 14:04:52.381645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 341/681] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:51 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1275 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:04:52.764142 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:52.764900 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:52.771637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:52.772242 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:52.773102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:52.773617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.105659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:53.107023 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:53.118412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:53.119789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.129398 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:53.136314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:53.136910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.144921 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-77a74c79-f456-4318-973a-2ee1288bc486 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1681 microversion: 2.1 time: 0.384883 May 24 14:04:53.167865 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 341/682] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:52 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:53.379062 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:53.387683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c81a1628-8125-4e4e-848d-bc07275b2133 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.288954 May 24 14:04:53.388507 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 342/683] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:53 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:04:53.400959 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:53.402210 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:53.408425 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:53.409101 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.410103 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:53.410715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.421369 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-68e2f587-72cd-4be2-af4d-b740fa03aaeb req-266e1b2e-26d4-41cd-a213-ed3ec9716852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50e64ca-9602-4aeb-a5fe-17c3969764d1", "tag": "b3254324-4c15-407e-9543-03ad6753b3e9"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:53.453655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-68e2f587-72cd-4be2-af4d-b740fa03aaeb req-266e1b2e-26d4-41cd-a213-ed3ec9716852 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:53.454602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-68e2f587-72cd-4be2-af4d-b740fa03aaeb req-266e1b2e-26d4-41cd-a213-ed3ec9716852 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.483877 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-68e2f587-72cd-4be2-af4d-b740fa03aaeb req-266e1b2e-26d4-41cd-a213-ed3ec9716852 service nova] Creating event network-changed:b3254324-4c15-407e-9543-03ad6753b3e9 for instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 on hv-cinder-84212 May 24 14:04:53.491671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-68e2f587-72cd-4be2-af4d-b740fa03aaeb req-266e1b2e-26d4-41cd-a213-ed3ec9716852 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075841 May 24 14:04:53.493043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 343/684] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:04:53.611442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-0a3d38b1-1a76-4c3b-b58d-4b3004c9ea54 req-6f952b48-7327-45d6-aae3-13ae83cd3f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:53.629383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0a3d38b1-1a76-4c3b-b58d-4b3004c9ea54 req-6f952b48-7327-45d6-aae3-13ae83cd3f95 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:53.631984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0a3d38b1-1a76-4c3b-b58d-4b3004c9ea54 req-6f952b48-7327-45d6-aae3-13ae83cd3f95 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:53.656239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-0a3d38b1-1a76-4c3b-b58d-4b3004c9ea54 req-6f952b48-7327-45d6-aae3-13ae83cd3f95 service nova] Creating event network-changed:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:04:53.662991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-0a3d38b1-1a76-4c3b-b58d-4b3004c9ea54 req-6f952b48-7327-45d6-aae3-13ae83cd3f95 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055843 May 24 14:04:53.664189 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 344/685] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:04:53.845157 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:53.852687 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-842b48a7-fb77-48f2-867f-65793676ead4 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.458290 May 24 14:04:53.859605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 342/686] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:53 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:54.175577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:54.176299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:54.183225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:54.184262 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:54.185075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:54.185622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:54.252347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:54.260192 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2f6e810f-69e5-45ad-88bf-36bcfccf8849 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1613 microversion: 2.1 time: 0.089253 May 24 14:04:54.261031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 345/687] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:54 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:54.404721 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:54.405338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:54.411244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:54.411698 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:54.412531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:54.412971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:54.547397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:54.554931 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-947fafb8-c8e7-4bbc-afdb-195dce3075b9 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.154939 May 24 14:04:54.555500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 343/688] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:54 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:54.870309 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:54.870946 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:54.877195 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:54.877705 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:54.878477 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:54.879077 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.029972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:55.043273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-976f5fdf-1d7e-4d56-b446-54778b3c23a0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.176924 May 24 14:04:55.044555 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 346/689] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:54 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:55.278057 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:55.278755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:55.285375 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:55.285820 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.286586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:55.287019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.318902 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:55.319357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.319800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lazy-loading 'fault' on Instance uuid 7cc2ee53-7340-4ef8-9fde-e631f1123d1b {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:04:55.368152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:55.376005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-06450d3f-b0c6-47ed-a661-2fc1618d2e1c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 200 len: 1331 microversion: 2.1 time: 0.102418 May 24 14:04:55.376562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 344/690] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:55 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:55.572332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:55.572936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:55.579973 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:55.580589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.581371 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:55.581810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.680522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-f560caa1-fae0-4ac1-b930-bc8ce61fada3 req-fb171444-f010-4b0a-959a-6c0cff87e0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc2ee53-7340-4ef8-9fde-e631f1123d1b", "name": "network-vif-deleted", "tag": "c81091ce-82fb-4359-8463-aeda233204d1"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:55.689211 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f560caa1-fae0-4ac1-b930-bc8ce61fada3 req-fb171444-f010-4b0a-959a-6c0cff87e0d8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:55.689659 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f560caa1-fae0-4ac1-b930-bc8ce61fada3 req-fb171444-f010-4b0a-959a-6c0cff87e0d8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:55.700470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-f560caa1-fae0-4ac1-b930-bc8ce61fada3 req-fb171444-f010-4b0a-959a-6c0cff87e0d8 service nova] Creating event network-vif-deleted:c81091ce-82fb-4359-8463-aeda233204d1 for instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b on hv-cinder-84212 May 24 14:04:55.705467 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-f560caa1-fae0-4ac1-b930-bc8ce61fada3 req-fb171444-f010-4b0a-959a-6c0cff87e0d8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028582 May 24 14:04:55.706067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 345/691] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:04:55.713193 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:55.720749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f592a641-944e-4d6e-b626-208fedd6d901 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.152970 May 24 14:04:55.721320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 347/692] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:55 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:56.063672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:56.064459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:56.071340 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:56.071791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:56.072573 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:56.073008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:56.393254 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:56.393864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:56.399913 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:56.400394 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:56.401169 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:56.401802 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:56.415784 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b HTTP/1.1 May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:04:56.418136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:04:56.419696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '7cc2ee53-7340-4ef8-9fde-e631f1123d1b'} May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:04:56.420639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:04:56.421879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:04:56.423045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:04:56.423045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-383ae113-c92f-4009-b504-43fe8af05418 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 404 len: 111 microversion: 2.1 time: 0.030277 May 24 14:04:56.423045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 348/693] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:56 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:04:56.428851 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7d6c7abf-3041-4536-958b-aa3b2dd08d95 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '.version_select at 0x7f33b588f820>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:56.448164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7d6c7abf-3041-4536-958b-aa3b2dd08d95 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441942616" status: 202 len: 0 microversion: 2.1 time: 0.023282 May 24 14:04:56.448970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 349/694] 10.222.0.24 () {58 vars in 1217 bytes} [Tue May 24 14:04:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441942616 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 14:04:56.454159 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:56.461803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dc0e4306-8c9c-425e-b492-18ebacd13b2e tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.404128 May 24 14:04:56.462412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 346/695] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:56 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:56.739726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:56.740602 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:56.750880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:56.751464 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:56.752394 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:56.752934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:56.963030 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:56.971658 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8b2b9b52-3b60-45bb-b127-cd04425acbcc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.236540 May 24 14:04:56.981275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 350/696] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:56 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:04:57.233434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36a5f4fc-deec-4838-bd05-0ccead2b1cb3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: .version_select at 0x7f33b5879790>, body: {"keypair": {"name": "tempest-keypair-2055428316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJua+z3ljH94pFSF05OFFtNbQ3w/FzgEWC3GLpl/gsJ/LLAOnUlAJ/sOMMKkka2lipQVSVh022+o3pw+jfsMxgpTSBKTMxyJ8AAcILTdbbbVwh8YEh0L9w0VgJ6bo0ZOqg=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:57.247443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-36a5f4fc-deec-4838-bd05-0ccead2b1cb3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:04:57.251441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-36a5f4fc-deec-4838-bd05-0ccead2b1cb3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:04:57.273699 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-36a5f4fc-deec-4838-bd05-0ccead2b1cb3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044106 May 24 14:04:57.274279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 347/697] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:04:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:04:57.478720 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:57.479239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:57.485626 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:57.486074 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:57.486838 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:57.487271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:57.491294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:57.647047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:57.656176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a9bb2d82-7982-4383-9186-7f16d86f1505 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.181424 May 24 14:04:57.656763 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 351/698] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:57 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:57.989207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:57.989832 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:57.996857 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:57.997289 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:57.998067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:57.998508 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:58.223961 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:58.232110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0b2b536e-e991-42b9-8b28-5aff563fd677 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.247303 May 24 14:04:58.232688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 348/699] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:57 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:58.652140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-209217168", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e5782d9-5791-4763-85b4-bfd8289d9060"}], "security_groups": [{"name": "tempest-securitygroup--585175273"}], "key_name": "tempest-keypair-2055428316", "user_data": "}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:04:58.659073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:58.673361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:58.673854 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:58.675773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:58.681150 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:58.681595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:58.682354 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:58.682959 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:58.754981 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] validate_networks() for [('2e5782d9-5791-4763-85b4-bfd8289d9060', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:04:58.759082 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=8 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:58.819715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:58.828208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3efaddac-707e-47e7-b356-db704abe5e6d tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.158964 May 24 14:04:58.829195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 349/700] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:58 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:04:59.119393 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:04:59.119834 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:04:59.120359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:04:59.120771 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:04:59.121299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:04:59.130155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:59.130598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:59.131387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:59.131811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:59.147689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:04:59.152076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Getting quotas for user 3eb0459bdac1456a900046e264835a6c and project 3db44af3db3441b7a0c5eb524eb35806. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:04:59.162494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:04:59.164730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:04:59.208417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-26a221e4-1dc8-4948-9fbd-40893de46a86 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.561113 May 24 14:04:59.209056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 352/701] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:04:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:04:59.220289 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-20fddeef-618f-4d13-bcc0-c2dc34750863 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:59.220928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-20fddeef-618f-4d13-bcc0-c2dc34750863 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:59.247794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:59.248429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:59.254701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:59.255148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:59.255943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:59.256372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:59.275047 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-20fddeef-618f-4d13-bcc0-c2dc34750863 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:59.282234 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-20fddeef-618f-4d13-bcc0-c2dc34750863 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1241 microversion: 2.1 time: 0.066303 May 24 14:04:59.283013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 350/702] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:59 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:04:59.402284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:59.409964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c1acbf84-a006-420f-88ab-14f3a463343f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.165980 May 24 14:04:59.410532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 353/703] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:59 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:04:59.845202 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:04:59.845720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:04:59.851608 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:59.852087 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:59.852838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:04:59.853268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:04:59.990533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:04:59.994188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:04:59.999155 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-72037487-d1f6-4cb5-b549-18db3105a042 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.157900 May 24 14:04:59.999722 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 351/704] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:04:59 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:00.299524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:00.300166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:00.306633 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:00.307076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:00.307888 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:00.308320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:00.375268 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:00.382959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-20f2eb73-ada0-48af-9446-c1c8636fda25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1301 microversion: 2.1 time: 0.087200 May 24 14:05:00.383532 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 354/705] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:00 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:00.430073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:00.430688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:00.438592 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:00.439036 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:00.440096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:00.440533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:00.575744 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:00.583158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-45b0ac19-82a3-4f02-ba2e-64e2227e11f6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.158901 May 24 14:05:00.583739 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 352/706] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:00 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:01.016521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:01.017135 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:01.023113 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:01.023562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:01.024360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:01.024798 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:01.154466 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:01.161862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d8a486fb-f6cb-4d5f-bfbd-f1e03799c60b tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.149251 May 24 14:05:01.162434 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 355/707] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:01 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:01.399455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:01.400449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:01.406819 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:01.407274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:01.408070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:01.408508 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:01.475706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:01.483570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8b37cb0e-35c6-477b-9fbd-30de36498c7d tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1299 microversion: 2.1 time: 0.087878 May 24 14:05:01.484208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 353/708] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:01 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:01.600411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:01.601023 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:01.607894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:01.608350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:01.609116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:01.609551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:01.741650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:01.750143 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7d90e775-e396-4f58-9088-b443099b0a14 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.153584 May 24 14:05:01.750717 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 356/709] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:01 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:02.178586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:02.179194 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:02.187009 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:02.187460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:02.188256 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:02.188694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:02.318163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:02.326327 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8b7c59d2-f89d-469b-b770-a526abc045bc tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.151575 May 24 14:05:02.326899 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 354/710] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:02 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:02.501463 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:02.502209 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:02.508349 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:02.508779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:02.509541 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:02.509980 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:02.641246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:02.648609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d57ac4bc-60f7-4c52-ba6a-3e9c8b4bd04b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.151000 May 24 14:05:02.649205 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 357/711] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:02 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:02.766791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:02.767350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:02.773787 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:02.774230 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:02.774992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:02.775426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:02.966557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:02.974012 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6096ecf9-a49a-4b74-aa94-ab5947bf5229 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.211236 May 24 14:05:02.974588 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 355/712] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:02 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:03.342883 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:03.343501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:03.350563 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:03.350749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:03.352016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:03.352671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:03.508636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:03.517967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-edf51caa-cfce-4a58-b238-21b289c15cde tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.179003 May 24 14:05:03.521993 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 358/713] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:03 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:03.528906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-31120ed7-1e40-4d5c-945b-34e8b733fb39 req-f5df67f1-ef50-400b-991e-0ac7b12160e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a76501-1472-4b0d-9375-864f11fcad0f", "tag": "2268d58f-b991-4dba-86f6-755a9bbcd564"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:03.541018 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-31120ed7-1e40-4d5c-945b-34e8b733fb39 req-f5df67f1-ef50-400b-991e-0ac7b12160e3 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:03.541477 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-31120ed7-1e40-4d5c-945b-34e8b733fb39 req-f5df67f1-ef50-400b-991e-0ac7b12160e3 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:03.552781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-31120ed7-1e40-4d5c-945b-34e8b733fb39 req-f5df67f1-ef50-400b-991e-0ac7b12160e3 service nova] Creating event network-changed:2268d58f-b991-4dba-86f6-755a9bbcd564 for instance 37a76501-1472-4b0d-9375-864f11fcad0f on hv-cinder-84212 May 24 14:05:03.559180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-31120ed7-1e40-4d5c-945b-34e8b733fb39 req-f5df67f1-ef50-400b-991e-0ac7b12160e3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034842 May 24 14:05:03.559797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 356/714] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:05:03.669321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:03.671639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:03.678271 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:03.678967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:03.679948 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:03.680547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:03.840045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:03.847900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a90e59c9-3654-434f-ac37-e9d880219dfc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.185923 May 24 14:05:03.848779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 359/715] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:03 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:03.993452 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:03.994096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:04.001049 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:04.001491 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:04.002312 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:04.002748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:04.141749 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:04.149061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d7c0219c-aa16-4bb9-b82e-b0a9dcccc6dc tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.160925 May 24 14:05:04.149619 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 357/716] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:03 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:04.535811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:04.536461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:04.543035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:04.543477 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:04.544253 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:04.544680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:04.676201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:04.683944 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ee3e9286-2b34-4a1e-b7ad-e5102142d62a tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.151918 May 24 14:05:04.684523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 360/717] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:04 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:04.865544 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:04.866161 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:04.872609 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:04.873061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:04.873827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:04.874269 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:05.000181 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:05.007541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f9e45844-b0ac-4ab6-a548-53a9b4f43b90 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.145900 May 24 14:05:05.008136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 358/718] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:04 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:05.166054 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:05.166636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:05.172606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:05.173051 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:05.173814 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:05.174250 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:05.302193 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:05.310185 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7dc67d29-7b85-4761-9f99-3ba88ac7e77d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.148081 May 24 14:05:05.310749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 361/719] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:05 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:05.703798 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:05.704465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:05.713245 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:05.713691 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:05.714673 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:05.715178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:05.844445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:05.852188 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5fe29969-8411-4bb1-9320-d84a8cc30922 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.154650 May 24 14:05:05.852999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 359/720] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:05 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:06.025242 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:06.026326 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:06.031037 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:06.036129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.036788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.037760 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.038294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.172306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-607bb588-1e42-4422-88e3-becfe41c27d0 req-cf33205e-010f-4d52-93f3-88087aa4a322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50e64ca-9602-4aeb-a5fe-17c3969764d1", "name": "network-vif-plugged", "status": "completed", "tag": "b3254324-4c15-407e-9543-03ad6753b3e9"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:06.184688 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:06.186729 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-607bb588-1e42-4422-88e3-becfe41c27d0 req-cf33205e-010f-4d52-93f3-88087aa4a322 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.187348 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-607bb588-1e42-4422-88e3-becfe41c27d0 req-cf33205e-010f-4d52-93f3-88087aa4a322 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.193946 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-92bc023c-faf7-43f5-819d-f4eacdb9270a tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.172875 May 24 14:05:06.195874 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 362/721] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:06 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:06.199763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-607bb588-1e42-4422-88e3-becfe41c27d0 req-cf33205e-010f-4d52-93f3-88087aa4a322 service nova] Creating event network-vif-plugged:b3254324-4c15-407e-9543-03ad6753b3e9 for instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 on hv-cinder-84212 May 24 14:05:06.205751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-607bb588-1e42-4422-88e3-becfe41c27d0 req-cf33205e-010f-4d52-93f3-88087aa4a322 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038637 May 24 14:05:06.206349 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 360/722] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:05:06.326648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:06.327198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:06.333215 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.333665 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.334418 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.334854 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.465340 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:06.472890 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a11179f8-bccc-4cfe-9135-f9d8ea148b8e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.150306 May 24 14:05:06.473460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 363/723] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:06 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:06.870831 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:06.871519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:06.877778 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.878221 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.878973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.879404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.918551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:06.919210 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:06.925347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.925873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.926642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:06.927065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:06.951311 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-014d8427-d2d1-40c8-a3b3-029ae49f5d1c tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/ips" status: 200 len: 151 microversion: 2.20 time: 0.037397 May 24 14:05:06.952295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 364/724] 10.222.0.24 () {60 vars in 1288 bytes} [Tue May 24 14:05:06 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 14:05:07.017994 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:07.025370 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bd4cf76a-a6b0-4870-b8d7-0c1476ab16e0 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.159451 May 24 14:05:07.025948 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 361/725] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:06 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:07.212895 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:07.213422 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:07.224235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:07.224691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:07.225504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:07.225941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:07.371007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:07.381466 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e28f04f2-045e-4543-b4e1-9b0eb96636e4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.172994 May 24 14:05:07.390917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 365/726] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:07 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:07.490024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:07.490634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:07.501827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:07.502328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:07.503118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:07.503553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:07.736533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:07.744212 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-16a8c735-24cf-428b-8400-a2158f9a5b89 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.258069 May 24 14:05:07.744770 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 362/727] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:07 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:08.042009 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:08.042929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:08.049828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.049828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.050681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.051183 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.202761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:08.210686 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-13cd7911-e137-432e-b131-4a406a635195 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.172537 May 24 14:05:08.211488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 366/728] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:08 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:08.220541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-dce18755-2111-428f-be56-033d4b8576cf req-cfc9b92f-9b8c-4fa1-9555-757fc38d709b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "name": "network-vif-plugged", "status": "completed", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:08.228953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-dce18755-2111-428f-be56-033d4b8576cf req-cfc9b92f-9b8c-4fa1-9555-757fc38d709b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.229494 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-dce18755-2111-428f-be56-033d4b8576cf req-cfc9b92f-9b8c-4fa1-9555-757fc38d709b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.241730 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-dce18755-2111-428f-be56-033d4b8576cf req-cfc9b92f-9b8c-4fa1-9555-757fc38d709b service nova] Creating event network-vif-plugged:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:05:08.247567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-dce18755-2111-428f-be56-033d4b8576cf req-cfc9b92f-9b8c-4fa1-9555-757fc38d709b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030566 May 24 14:05:08.248191 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 363/729] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:08.397317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:08.397932 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:08.405355 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.405807 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.406582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.407017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.539521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:08.547447 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1eb4e69a-f4da-40b5-9653-a34c4dbd004b tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.153955 May 24 14:05:08.548431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 367/730] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:08 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:08.763091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:08.763801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:08.771896 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.772333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.773109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.773547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.905629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:08.912961 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5038c2e2-dd09-4d32-aef5-5ede9df6ee67 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.155674 May 24 14:05:08.913524 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 364/731] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:08 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:08.972691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:08.973230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:08.978996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.979442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:08.980236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:08.980671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.002996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lazy-loading 'flavor' on Instance uuid 762edbfc-761c-41c1-9404-8936a3869671 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:05:09.006380 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=100 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:09.189167 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:09.189910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:09.229039 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:09.230013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:09.235029 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:09.239297 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.239924 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.241315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.241859 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.266134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3fddc003-f07c-4a96-ba6c-371903565806 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/action" status: 202 len: 0 microversion: 2.20 time: 0.297274 May 24 14:05:09.267849 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 368/732] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 24 14:05:08 2022] POST /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 14:05:09.275042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:09.275731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:09.279876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=14 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:09.283008 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.283462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.284344 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.284782 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.378220 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:09.385913 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-444f6dab-0460-4fb5-9e29-2c6c832d8fc8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1263 microversion: 2.1 time: 0.161536 May 24 14:05:09.386523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 365/733] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:09 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:09.417875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:09.426634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:09.428213 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:09.429412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cab98680-5ecf-4dad-86af-f655af837147 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.158434 May 24 14:05:09.430276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 369/734] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:09 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:05:09.564930 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:09.565544 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:09.572068 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.572526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.573299 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.573739 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.708843 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:09.716245 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-934e557a-fee8-45f0-b96f-fac671641f93 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.155881 May 24 14:05:09.716830 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 366/735] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:09 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:09.929942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:09.930567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:09.936993 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.937505 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:09.938460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:09.938893 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.073603 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.082914 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e19257a7-5396-4f77-bbd5-7b47ab3a6b11 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.157129 May 24 14:05:10.083734 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 370/736] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:09 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:10.261238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7bd43596-bdbd-4bf9-836a-f3358ebb19ed req-25cc2314-8a24-4bf3-9beb-1f90688b838e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a76501-1472-4b0d-9375-864f11fcad0f", "name": "network-vif-plugged", "status": "completed", "tag": "2268d58f-b991-4dba-86f6-755a9bbcd564"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:10.270494 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7bd43596-bdbd-4bf9-836a-f3358ebb19ed req-25cc2314-8a24-4bf3-9beb-1f90688b838e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.270942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7bd43596-bdbd-4bf9-836a-f3358ebb19ed req-25cc2314-8a24-4bf3-9beb-1f90688b838e service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.282554 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7bd43596-bdbd-4bf9-836a-f3358ebb19ed req-25cc2314-8a24-4bf3-9beb-1f90688b838e service nova] Creating event network-vif-plugged:2268d58f-b991-4dba-86f6-755a9bbcd564 for instance 37a76501-1472-4b0d-9375-864f11fcad0f on hv-cinder-84212 May 24 14:05:10.287883 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7bd43596-bdbd-4bf9-836a-f3358ebb19ed req-25cc2314-8a24-4bf3-9beb-1f90688b838e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030301 May 24 14:05:10.288458 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 367/737] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:10.403039 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:10.403656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:10.410337 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.410790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.411558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.412045 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.448808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:10.449611 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:10.456974 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.457506 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.458384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.458886 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.548242 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.555640 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-96ecd151-7da0-4dc5-8802-6d3e4091a711 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1450 microversion: 2.1 time: 0.156518 May 24 14:05:10.556256 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 371/738] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:10 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:10.571800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:10.572431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:10.578916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.579354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.580144 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.580580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.589443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.597610 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.599271 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.600565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0b2a1c92-9ca0-4cff-a66f-dce7379c5c6e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.156178 May 24 14:05:10.601143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 368/739] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:10 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:05:10.707613 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.715032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-edafdc25-ee02-43d6-8ec9-ba75a3d9d215 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1450 microversion: 2.1 time: 0.147061 May 24 14:05:10.715594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 372/740] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:10 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:05:10.733746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:10.734810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:10.740961 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.741413 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.742215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:10.743032 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:10.927929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:10.935808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-236ae4ef-a443-477c-aa8a-b44d5642a1fc tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.206103 May 24 14:05:10.936431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 369/741] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:10 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:11.099977 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:11.100598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:11.106561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:11.107031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:11.107789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:11.108281 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:11.242909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:11.250692 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-40e5d94e-cb6c-4446-952a-3298da01d857 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1260 microversion: 2.1 time: 0.154734 May 24 14:05:11.251265 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 373/742] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:11 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:11.619067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:11.620579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:11.628030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:11.628654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:11.629498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:11.630050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:11.952821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:11.953697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:11.961070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:11.961070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:11.962221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:11.962670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:11.987350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:12.004070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:12.006070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:12.007559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-da063339-f477-4f1d-adf7-aa7fbda4fbe5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.392684 May 24 14:05:12.018979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 370/743] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:11 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:12.105889 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:12.114229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d2a986dc-a783-40d3-82c9-5d84a745bd88 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1366 microversion: 2.1 time: 0.165343 May 24 14:05:12.114821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 374/744] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:11 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:05:12.268914 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:12.269553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:12.275441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:12.275915 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:12.276664 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:12.277088 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:12.281650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=100 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:12.506068 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:12.514195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-959c1e37-9b6f-4820-8ce8-9cef7d3f72aa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1444 microversion: 2.1 time: 0.249694 May 24 14:05:12.514855 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 371/745] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:12 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1444 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:12.530921 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:12.531530 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:12.538003 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:12.538451 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:12.539219 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:12.539655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:12.669654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:12.677302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6a625b43-077d-43e2-a692-e46364ce2bd7 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1444 microversion: 2.1 time: 0.150311 May 24 14:05:12.677872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 375/746] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:12 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:13.001118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-f84d4484-6001-47ba-bd28-89f2d00c22b6 req-5b7c1e7f-2cbb-445c-926d-0bf44a4f08b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50e64ca-9602-4aeb-a5fe-17c3969764d1", "tag": "b3254324-4c15-407e-9543-03ad6753b3e9"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:13.027323 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:13.028289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:13.030710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f84d4484-6001-47ba-bd28-89f2d00c22b6 req-5b7c1e7f-2cbb-445c-926d-0bf44a4f08b3 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.033559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f84d4484-6001-47ba-bd28-89f2d00c22b6 req-5b7c1e7f-2cbb-445c-926d-0bf44a4f08b3 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.039097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.039556 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.040515 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.040961 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.050973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-f84d4484-6001-47ba-bd28-89f2d00c22b6 req-5b7c1e7f-2cbb-445c-926d-0bf44a4f08b3 service nova] Creating event network-changed:b3254324-4c15-407e-9543-03ad6753b3e9 for instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 on hv-cinder-84212 May 24 14:05:13.056115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-f84d4484-6001-47ba-bd28-89f2d00c22b6 req-5b7c1e7f-2cbb-445c-926d-0bf44a4f08b3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067546 May 24 14:05:13.057367 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 372/747] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:05:13.133281 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:13.134171 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:13.141055 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.141659 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.142567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.143081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.227530 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:13.243361 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:13.245160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:13.246444 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a0ed7687-0fb3-45b1-a3e6-9f1e4fba4805 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.223752 May 24 14:05:13.247387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 376/748] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:13 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:05:13.297063 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:13.305712 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e7675076-271c-4a4a-b188-aabb14e25e29 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1557 microversion: 2.1 time: 0.176876 May 24 14:05:13.306374 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 373/749] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:05:13 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:05:13.323921 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:13.324322 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:13.331305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.332157 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.332738 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:13.333239 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:13.457297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dcdf93d9-a270-4a0e-be34-45a8216c46dd tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136397 May 24 14:05:13.460095 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 377/750] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 14:05:13 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:14.266476 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:14.267090 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:14.276512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:14.277317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:14.278274 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:14.279026 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:14.784195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:14.793465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:14.795464 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:14.800702 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-028dd1b7-60c3-4675-8e0b-3f70c62ddb46 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.539245 May 24 14:05:14.801970 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 374/751] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:14 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:14.828108 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-c0a12077-832f-48d6-bb64-9b8f04376483 req-9509a9b9-64a8-44d4-9883-ab51f3c87f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:14.836954 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-c0a12077-832f-48d6-bb64-9b8f04376483 req-9509a9b9-64a8-44d4-9883-ab51f3c87f54 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:14.837401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-c0a12077-832f-48d6-bb64-9b8f04376483 req-9509a9b9-64a8-44d4-9883-ab51f3c87f54 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:14.849520 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-c0a12077-832f-48d6-bb64-9b8f04376483 req-9509a9b9-64a8-44d4-9883-ab51f3c87f54 service nova] Creating event network-changed:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:05:14.854567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-c0a12077-832f-48d6-bb64-9b8f04376483 req-9509a9b9-64a8-44d4-9883-ab51f3c87f54 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 May 24 14:05:14.855332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 378/752] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:15.265482 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-038c0660-f585-4c80-a5ec-af8a1ed28cb0 req-afb10054-df5b-4a0c-9b4b-f49d64c74e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a76501-1472-4b0d-9375-864f11fcad0f", "tag": "2268d58f-b991-4dba-86f6-755a9bbcd564"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:15.274559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-038c0660-f585-4c80-a5ec-af8a1ed28cb0 req-afb10054-df5b-4a0c-9b4b-f49d64c74e52 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:15.275693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-038c0660-f585-4c80-a5ec-af8a1ed28cb0 req-afb10054-df5b-4a0c-9b4b-f49d64c74e52 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:15.289624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-038c0660-f585-4c80-a5ec-af8a1ed28cb0 req-afb10054-df5b-4a0c-9b4b-f49d64c74e52 service nova] Creating event network-changed:2268d58f-b991-4dba-86f6-755a9bbcd564 for instance 37a76501-1472-4b0d-9375-864f11fcad0f on hv-cinder-84212 May 24 14:05:15.296493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-038c0660-f585-4c80-a5ec-af8a1ed28cb0 req-afb10054-df5b-4a0c-9b4b-f49d64c74e52 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034830 May 24 14:05:15.298508 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 375/753] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:15.819450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:15.820576 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:15.828868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:15.829807 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:15.830552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:15.831189 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:15.995394 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:16.005865 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:16.008415 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:16.011106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fef24db0-2d8a-4d91-9dc8-499ce338f956 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.195506 May 24 14:05:16.024328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 379/754] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:15 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:17.031538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:17.032791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:17.039062 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:17.039511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:17.040311 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:17.040746 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:17.168570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:17.177106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:17.178581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:17.179734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-73eeaf83-92fe-4bee-bdb9-6cf88265d2bd tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.152952 May 24 14:05:17.180340 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 376/755] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:17 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:18.197927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:18.198533 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:18.205305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:18.205749 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:18.206561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:18.206943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:18.336441 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:18.344406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:18.346305 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:18.347457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e11c8907-16e7-4a78-b204-d93a7a42da7d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.153476 May 24 14:05:18.348083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 380/756] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:18 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:19.366316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:19.366881 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:19.373636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:19.374081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:19.374828 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:19.375256 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:19.509315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:19.517621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:19.519146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:19.520319 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-891a81c9-fe53-4cad-9556-6d2b890577ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.157953 May 24 14:05:19.520882 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 377/757] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:19 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:20.539151 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:20.539764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:20.546483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:20.546934 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:20.547698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:20.548218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:20.673475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:20.681779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:20.683292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:20.684481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-869d08a3-d9cb-48d1-adb6-3c300b973e0a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.149356 May 24 14:05:20.685044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 381/758] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:20 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:21.702573 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:21.703102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:21.709801 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:21.710238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:21.710989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:21.711419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:21.839200 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:21.847623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:21.849155 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:21.850290 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-01f3069b-d4c4-42b6-a966-2e60e685a081 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1744 microversion: 2.20 time: 0.151708 May 24 14:05:21.850850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 378/759] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:21 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:22.869315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:22.869924 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:22.877094 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:22.877551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:22.878307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:22.878737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:23.010211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:23.018248 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:23.019766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:23.020952 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2c64c6ad-5089-4f8c-92c6-90ea5be2cbb0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1744 microversion: 2.20 time: 0.155865 May 24 14:05:23.021518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 382/760] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:22 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:24.039545 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:24.040184 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:24.046328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:24.046768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:24.047525 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:24.047995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:24.180855 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:24.188866 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:24.190510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:24.191681 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a1d8d798-b4ff-4edb-a018-5b7a5a1a4026 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1744 microversion: 2.20 time: 0.156208 May 24 14:05:24.192341 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 379/761] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:24 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:25.210465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:25.211069 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:25.217478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:25.217922 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:25.218701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:25.219129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:25.345335 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:25.353423 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:25.355236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:25.356549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ac03ff5c-f4ef-4e6c-9e53-167cc80ad184 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1744 microversion: 2.20 time: 0.150080 May 24 14:05:25.357150 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 383/762] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:25 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:26.033159 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-64535664-e5de-4f5c-b8e1-1144b6840b3c req-3ea22a7d-0ce6-440d-82c6-4004d0f01ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "name": "network-vif-plugged", "status": "completed", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:26.041825 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-64535664-e5de-4f5c-b8e1-1144b6840b3c req-3ea22a7d-0ce6-440d-82c6-4004d0f01ecb service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:26.042285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-64535664-e5de-4f5c-b8e1-1144b6840b3c req-3ea22a7d-0ce6-440d-82c6-4004d0f01ecb service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:26.057035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-64535664-e5de-4f5c-b8e1-1144b6840b3c req-3ea22a7d-0ce6-440d-82c6-4004d0f01ecb service nova] Creating event network-vif-plugged:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:05:26.062192 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-64535664-e5de-4f5c-b8e1-1144b6840b3c req-3ea22a7d-0ce6-440d-82c6-4004d0f01ecb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033571 May 24 14:05:26.062785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 380/763] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:26.378020 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:26.378634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:26.385053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:26.385534 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:26.386325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:26.386758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:26.404862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:26.518550 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:26.526439 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:26.527967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:26.529101 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a7173e64-13dd-4080-909f-49de057e97da tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1744 microversion: 2.20 time: 0.155008 May 24 14:05:26.529664 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 384/764] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:26 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:27.549952 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:27.550647 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:27.557301 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:27.557745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:27.558499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:27.558933 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:27.685522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:27.693584 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:27.695093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:27.696277 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-46e09977-9fc9-410e-9887-0c290f1efd63 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1744 microversion: 2.20 time: 0.151561 May 24 14:05:27.696844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 381/765] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:27 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:28.714291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:28.714900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:28.721700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:28.722156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:28.722920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:28.723359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:28.868099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:28.877073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:28.878598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:28.879762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6dded5ee-8c81-43e1-9b75-17a820c200d7 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.169368 May 24 14:05:28.880692 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 385/766] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:28 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:29.898617 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:29.899287 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:29.906019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:29.906537 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:29.908082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:29.908743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:30.040635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:30.049515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:30.051463 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:30.053693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b77d9e1d-6939-46d9-8ec9-29aec65afd10 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.159054 May 24 14:05:30.054272 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 382/767] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:29 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:05:31.072417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:31.073108 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:31.080500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:31.080955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:31.081859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:31.082299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:31.216502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:31.226070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:31.227567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:31.229330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7f9d8cb0-7274-4797-9b93-1bbbece9ea55 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.161319 May 24 14:05:31.229890 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 386/768] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:31 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:32.247697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:32.248450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:32.255197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:32.256264 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:32.256483 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:32.256923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:32.400248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:32.408590 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:32.410116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:32.411283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8355d32b-995e-4d6f-b1cd-2e18b4774a40 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.167777 May 24 14:05:32.412017 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 383/769] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:32 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:33.430565 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:33.431427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:33.437488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:33.437943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:33.438711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:33.439365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:33.587839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:33.601478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:33.604046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:33.605202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-312cb452-134c-467e-ab1e-87903c75daec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.178737 May 24 14:05:33.606025 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 387/770] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:33 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:34.624302 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:34.625720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:34.632304 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:34.632756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:34.633523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:34.633957 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:34.774919 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:34.783430 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:34.784986 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:34.786175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f4e50e21-7c5e-4245-9cb1-7f53663fc6f2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.165755 May 24 14:05:34.786752 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 384/771] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:34 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:35.804553 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:35.805106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:35.811783 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:35.812335 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:35.813191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:35.813700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:35.951949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:35.960274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:35.962134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:35.963358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a4a6f49b-3876-40a3-aa60-c19d4a86cab5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.162797 May 24 14:05:35.964312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 388/772] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:35 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:36.982432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:36.983680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:36.990542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:36.991078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:36.991976 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:36.992486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:37.189486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:37.198177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:37.200111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:37.201540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fe53c2d0-7164-4dc8-849b-436959ce51ed tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.223156 May 24 14:05:37.214109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 385/773] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:36 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:38.221655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:38.223092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:38.226659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=53 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:38.230543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:38.231063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:38.231943 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:38.232548 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:38.435376 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:38.447959 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:38.449504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:38.450667 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b2fac302-ea6c-410d-858c-0ccd3dcca3d0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1739 microversion: 2.20 time: 0.233779 May 24 14:05:38.451236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 389/774] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:38 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:39.467827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:39.468447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:39.470845 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=41 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:39.476784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:39.477226 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:39.477978 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:39.478407 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:39.605106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:39.613529 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:39.615075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:39.616246 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-920e2c25-f8b0-4144-9534-d60c3626f33d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1721 microversion: 2.20 time: 0.152305 May 24 14:05:39.616824 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 386/775] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:39 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:40.634348 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:40.634956 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:40.641514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:40.641963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:40.642721 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:40.643660 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:40.775324 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:40.783436 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:40.785764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:40.786915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8472effc-5913-4277-b976-c9d1e8260ac5 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1721 microversion: 2.20 time: 0.156417 May 24 14:05:40.787470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 390/776] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:40 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:41.805518 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:41.806056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:41.812788 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:41.813246 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:41.814082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:41.814563 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:41.942158 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:41.950355 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:41.951910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:41.953059 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3ce830d8-be3c-4491-b408-a386d164ab74 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1721 microversion: 2.20 time: 0.151513 May 24 14:05:41.953616 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 387/777] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:41 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:42.053262 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-b547c7cd-168a-4274-b93a-3bff894478db req-dba9d06a-0623-407e-a3c6-717860e18344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "name": "network-vif-unplugged", "status": "completed", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:42.069233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b547c7cd-168a-4274-b93a-3bff894478db req-dba9d06a-0623-407e-a3c6-717860e18344 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:42.069672 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b547c7cd-168a-4274-b93a-3bff894478db req-dba9d06a-0623-407e-a3c6-717860e18344 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:42.080437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-b547c7cd-168a-4274-b93a-3bff894478db req-dba9d06a-0623-407e-a3c6-717860e18344 service nova] Creating event network-vif-unplugged:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:05:42.085813 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-b547c7cd-168a-4274-b93a-3bff894478db req-dba9d06a-0623-407e-a3c6-717860e18344 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036742 May 24 14:05:42.086414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 391/778] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:05:42.971510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:42.972206 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:42.978637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:42.979087 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:42.979878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:42.980322 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:42.982829 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=89 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:43.116906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:43.125040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:43.126539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:43.127781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fbb8a2d0-ef59-40d6-b339-fc24a9c566ef tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1664 microversion: 2.20 time: 0.160196 May 24 14:05:43.128486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 388/779] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:42 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:43.146449 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cc36a97-306a-4e8f-bc66-decad123af00"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:43.147582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:43.153822 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.154269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.155050 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.155479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.418417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-989ee13a-9e30-4198-b371-eb18ff5ea046 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277071 May 24 14:05:43.419060 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 392/780] 10.222.0.24 () {62 vars in 1363 bytes} [Tue May 24 14:05:43 2022] POST /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 14:05:43.532051 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:43.532589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:43.538971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.539429 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.540244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.540682 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.779797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a9486e83-a60e-4e5c-b194-1cef479560c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-volume_attachments/9cc36a97-306a-4e8f-bc66-decad123af00" status: 202 len: 0 microversion: 2.20 time: 0.251788 May 24 14:05:43.780540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 389/781] 10.222.0.24 () {60 vars in 1456 bytes} [Tue May 24 14:05:43 2022] DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-volume_attachments/9cc36a97-306a-4e8f-bc66-decad123af00 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 14:05:43.836892 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:05:43.837460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:43.843478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.843966 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.844727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.845162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.934036 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e152856c-11ee-466c-bc54-66e899fd3401 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "POST /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/action" status: 202 len: 0 microversion: 2.20 time: 0.101061 May 24 14:05:43.934997 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 393/782] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 24 14:05:43 2022] POST /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 24 14:05:43.943437 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:43.944214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:43.950683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.951131 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:43.951922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:43.952351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:44.089284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:44.097410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:44.098947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:44.100136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a5abfcdf-48d0-46d6-b6b0-5c6dede241c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1672 microversion: 2.20 time: 0.161197 May 24 14:05:44.100708 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 390/783] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:43 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:45.118923 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:45.119831 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:45.125924 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:45.126313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:45.127078 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:45.127516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:45.259812 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:45.267920 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:45.269428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:45.270838 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-580f0c0f-5459-4f11-8d55-f653c73c2e30 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.156420 May 24 14:05:45.271411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 394/784] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:45 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:46.290983 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:46.291666 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:46.307078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:46.307844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:46.308812 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:46.309423 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:46.476424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:46.486831 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:46.490642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:46.493103 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a2fa16cc-bf76-4a6f-aabe-84903b56aa67 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.207189 May 24 14:05:46.504771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 391/785] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:46 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:47.515065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:47.516380 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:47.524650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:47.525217 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:47.526113 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:47.526569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:47.669664 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:47.680127 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:47.681910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:47.683443 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b08d2c18-8bc5-4c39-a1a7-8db8931a6051 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.172866 May 24 14:05:47.684311 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 395/786] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:47 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:48.703226 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:48.703985 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:48.711586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:48.712067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:48.712848 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:48.713287 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:49.004117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:49.013193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:49.014807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:49.016102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-297e8421-03d6-4eef-81cf-8420eafd8b71 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.317816 May 24 14:05:49.016705 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 392/787] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:48 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:50.034435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:50.035041 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:50.041601 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:50.042048 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:50.042806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:50.043352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:50.193927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:50.201838 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:50.203361 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:50.204545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f28178b2-5d20-4cd4-8e36-d1f1f4d6d545 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.174007 May 24 14:05:50.215414 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 396/788] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:50 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:51.223149 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:51.223811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:51.230328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:51.230784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:51.231546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:51.232015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:51.386061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:51.393935 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:51.395483 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:51.396662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b323bc29-101c-4477-81af-cea25d0d93c9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.177781 May 24 14:05:51.397225 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 393/789] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:51 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:52.414708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:52.416012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:52.422864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:52.423303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:52.424090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:52.424522 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:52.571500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:52.579587 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:52.581140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:52.582297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1f4dd147-0238-4bd9-91e4-a0d9ca9b6ffb tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.171757 May 24 14:05:52.582860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 397/790] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:52 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:53.601071 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:53.601888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:53.608217 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:53.608664 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:53.609450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:53.609866 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:53.745881 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:53.755091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:53.757863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:53.759092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-55715d47-2f67-454a-b9b0-c4142f314449 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.162325 May 24 14:05:53.770586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 394/791] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:53 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:54.781024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:54.781634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:54.791844 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:54.792609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:54.793391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:54.793992 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:54.800646 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:05:54.933841 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:54.942427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:54.944225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:54.945394 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2238f708-575c-4a8c-b4e2-502c58f4ca7a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.168734 May 24 14:05:54.945958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 398/792] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:54 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:55.963317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:55.963940 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:55.969807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:55.970251 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:55.971003 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:55.971428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:56.117247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:56.126835 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:56.128377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:56.129534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bee113e0-2ddc-41c4-a957-641023423898 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.171015 May 24 14:05:56.130092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 395/793] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:55 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:57.149935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:57.150582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:57.157034 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:57.157477 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:57.158229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:57.158656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:57.285314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:57.293589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:57.295098 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:57.296275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1780e1e4-152c-4a01-8a62-782cb85c9c60 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.150642 May 24 14:05:57.296830 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 399/794] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:57 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:58.314555 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:58.315167 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:58.321731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:58.322182 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:58.322944 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:58.323383 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:58.450435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:58.458226 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:58.460633 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:58.461817 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7fd3ca83-05c4-400b-bb86-c4bbb87819ea tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.151186 May 24 14:05:58.462373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 396/795] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:58 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:05:59.480343 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:05:59.480979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:05:59.487439 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:59.487919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:59.488686 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:05:59.489120 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:05:59.618483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:59.626623 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:59.628171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:05:59.629287 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a7638e7c-7fa7-48d9-87cd-c28d92485201 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.152896 May 24 14:05:59.629845 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 400/796] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:05:59 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:00.648005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:00.648615 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:00.654996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:00.655444 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:00.656222 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:00.656649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:00.787510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:00.795689 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:00.797236 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:00.798392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-df8d616c-f6df-4fa3-9077-5a3eeb228557 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.155139 May 24 14:06:00.798955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 397/797] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:00 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:01.817060 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:01.817614 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:01.824668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:01.825113 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:01.825873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:01.826333 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:01.954362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:01.962411 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:01.963942 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:01.965076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5b475482-2c1f-4536-bb79-56100b0f34e0 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.152002 May 24 14:06:01.965650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 401/798] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:01 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:02.983962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:02.984492 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:02.991376 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:02.991861 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:02.992625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:02.993064 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:03.121850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:03.129693 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:03.131265 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:03.132464 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b58767f-23f9-4df5-9214-65217c57a28e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.152582 May 24 14:06:03.133016 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 398/799] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:02 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:04.150774 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:04.151375 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:04.157461 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:04.157900 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:04.158655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:04.159084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:04.294670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:04.303204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:04.304727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:04.305883 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f6f38acd-dbac-4b88-9d25-aeed77d9457a tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.159349 May 24 14:06:04.306448 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 402/800] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:04 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:05.324363 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:05.324942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:05.331431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:05.331912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:05.332665 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:05.333093 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:05.460078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:05.467952 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:05.469466 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:05.470606 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8d643e67-b92b-4ca0-b8ca-10e9eed9b08d tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.150314 May 24 14:06:05.471169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 399/801] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:05 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:06.489273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:06.489864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:06.497043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:06.497484 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:06.498240 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:06.498673 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:06.627409 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:06.636087 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:06.637698 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:06.638933 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6836fea2-a9a5-4c3c-a900-5ab4250606ec tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.153537 May 24 14:06:06.639582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 403/802] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:06 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:07.657621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:07.658163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:07.665306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:07.665750 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:07.666511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:07.666951 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:07.796715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:07.804539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:07.806051 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:07.807196 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3ac4c584-4330-4c31-a228-cc33d01d68f9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.153527 May 24 14:06:07.807751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 400/803] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:07 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:08.198983 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-b95a0090-6f41-43c6-9dd5-60beab6b3853 req-855e5654-7a64-4ce1-9087-f225385c591b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "name": "network-vif-plugged", "status": "completed", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:06:08.207776 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b95a0090-6f41-43c6-9dd5-60beab6b3853 req-855e5654-7a64-4ce1-9087-f225385c591b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:08.208251 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b95a0090-6f41-43c6-9dd5-60beab6b3853 req-855e5654-7a64-4ce1-9087-f225385c591b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:08.219853 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-b95a0090-6f41-43c6-9dd5-60beab6b3853 req-855e5654-7a64-4ce1-9087-f225385c591b service nova] Creating event network-vif-plugged:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:06:08.224904 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-b95a0090-6f41-43c6-9dd5-60beab6b3853 req-855e5654-7a64-4ce1-9087-f225385c591b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029424 May 24 14:06:08.225668 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 404/804] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:06:08.825183 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:08.826515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:08.832185 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:08.832630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:08.833378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:08.833823 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:08.962953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:08.970771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:08.972319 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:08.973468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-25c7d9b8-1172-4a47-b805-b5992c6a8c5f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.152255 May 24 14:06:08.974024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 401/805] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:08 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:09.993490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:09.994187 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:09.996449 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=34 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:10.002131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:10.002574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:10.003328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:10.003753 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:10.132706 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:10.141402 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:10.142963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:10.144162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6c299040-57a6-457e-8f47-1d63b9d97cc6 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1730 microversion: 2.20 time: 0.156133 May 24 14:06:10.144730 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 405/806] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:09 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:11.162714 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:11.164387 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:11.166975 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=32 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:11.173493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:11.174185 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:11.175316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:11.175797 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:11.180363 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:11.312022 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:11.320481 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:11.322053 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:06:11.323215 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-562af6d8-d35a-4074-bde1-8b37bc609631 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1717 microversion: 2.20 time: 0.164928 May 24 14:06:11.323781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 402/807] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:06:11 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:06:58.437504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:06:58.438069 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:58.439958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:58.440733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=42 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:58.446075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:58.446524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:58.447273 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:58.447700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:58.470649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-53aee20f-18a4-428b-89d9-aa440d31910f tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/ips" status: 200 len: 150 microversion: 2.1 time: 0.037287 May 24 14:06:58.471209 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 406/808] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 14:06:58 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:06:59.789353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c03e121c-8764-4444-9196-04a1f2c4656a"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:06:59.790745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:06:59.793598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:59.794629 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=4 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:06:59.803235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:59.803948 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:06:59.805131 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:06:59.805811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:00.049818 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2f321e16-8c48-4961-8359-3074ff2a50e7 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "POST /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264117 May 24 14:07:00.050415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 403/809] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:06:59 2022] POST /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:07:07.711119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:07.711614 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:07.718210 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:07.718663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:07.719429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:07.719894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:07.799974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lazy-loading 'services' on Instance uuid 37a76501-1472-4b0d-9375-864f11fcad0f {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:07:07.869295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3738aa62-4d22-4703-8b2f-299353aea0b0 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments/c03e121c-8764-4444-9196-04a1f2c4656a" status: 202 len: 0 microversion: 2.1 time: 0.161870 May 24 14:07:07.869879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 407/810] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:07:07 2022] DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments/c03e121c-8764-4444-9196-04a1f2c4656a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:07:07.880064 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:07.881183 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:07.888914 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:07.889407 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:07.890984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:07.891421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:07.925181 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6c8d742f-4fbf-473e-8df5-2bd35b514dc4 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050533 May 24 14:07:07.925731 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 404/811] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:07:07 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:08.938332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:08.939419 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:08.945707 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:08.946155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:08.947510 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:08.947980 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:08.976116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8ddbaa02-894c-49d5-9135-eb336791dd25 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042804 May 24 14:07:08.976666 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 408/812] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:07:08 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 14:07:09.033243 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:09.033753 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:09.040159 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:09.040655 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:09.041409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:09.041842 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:09.066001 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:07:09.139912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-76260093-196e-48c6-93f7-3208fb46f163 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 204 len: 0 microversion: 2.1 time: 0.110115 May 24 14:07:09.140509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 405/813] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:09 2022] DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:07:09.148673 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:09.149291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:09.156035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:09.156487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:09.157247 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:09.157683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:09.287131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:09.294618 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-619a57da-4cef-4832-8615-cbcc564a5c05 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1681 microversion: 2.1 time: 0.149870 May 24 14:07:09.295176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 409/814] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:09 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:10.312121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:10.312744 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:10.319275 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:10.319730 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:10.320528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:10.320966 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:10.458389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:10.466677 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2a642e1c-0bac-4f2e-9c0c-6b1cc31af6ed tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1681 microversion: 2.1 time: 0.158950 May 24 14:07:10.467247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 406/815] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:10 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:11.483695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:11.484317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:11.491034 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:11.491489 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:11.492300 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:11.492743 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:11.628919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb0459bdac1456a900046e264835a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db44af3db3441b7a0c5eb524eb35806', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:11.637336 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-05dc93d8-3f99-478b-9957-28da8ba95e79 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 200 len: 1681 microversion: 2.1 time: 0.157694 May 24 14:07:11.637904 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 410/816] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:11 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:12.166626 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-b89399f1-118c-4542-94f8-70b880eb8f1e req-ffbd7ac8-8076-4cdd-92e2-ae89906b5dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a76501-1472-4b0d-9375-864f11fcad0f", "name": "network-vif-deleted", "tag": "2268d58f-b991-4dba-86f6-755a9bbcd564"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:12.175148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-b89399f1-118c-4542-94f8-70b880eb8f1e req-ffbd7ac8-8076-4cdd-92e2-ae89906b5dad service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:12.175857 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-b89399f1-118c-4542-94f8-70b880eb8f1e req-ffbd7ac8-8076-4cdd-92e2-ae89906b5dad service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:12.190178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-b89399f1-118c-4542-94f8-70b880eb8f1e req-ffbd7ac8-8076-4cdd-92e2-ae89906b5dad service nova] Creating event network-vif-deleted:2268d58f-b991-4dba-86f6-755a9bbcd564 for instance 37a76501-1472-4b0d-9375-864f11fcad0f on hv-cinder-84212 May 24 14:07:12.195445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-b89399f1-118c-4542-94f8-70b880eb8f1e req-ffbd7ac8-8076-4cdd-92e2-ae89906b5dad service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097801 May 24 14:07:12.196163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 407/817] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:12.655588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:12.656524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:12.663533 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:12.664032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:12.664853 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:12.665290 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:12.679568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f HTTP/1.1 May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:12.682005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:12.683638 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '37a76501-1472-4b0d-9375-864f11fcad0f'} May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:12.684590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:12.686002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:12.687368 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:12.687368 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-67848a02-2fda-437a-810d-692b73acecc8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 404 len: 111 microversion: 2.1 time: 0.033541 May 24 14:07:12.687654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 411/818] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:12 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:12.693294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-966a8e18-ff52-4329-ba56-6bfecfe83bab tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '.version_select at 0x7f33b57d9700>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:12.712772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-966a8e18-ff52-4329-ba56-6bfecfe83bab tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055428316" status: 202 len: 0 microversion: 2.1 time: 0.023547 May 24 14:07:12.717328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 408/819] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 24 14:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055428316 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:07:14.480916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:14.481983 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:14.489229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:14.489681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:14.490450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:14.491058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:14.505645 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f HTTP/1.1 May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:14.507437 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.509084 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '37a76501-1472-4b0d-9375-864f11fcad0f'} May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:14.510864 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.512358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:14.513689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:14.513689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fbd18427-4c62-45f3-8dfd-67490699f0ca tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 404 len: 111 microversion: 2.1 time: 0.033352 May 24 14:07:14.513689 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 412/820] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:14 2022] DELETE /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:14.518522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:14.519254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 37a76501-1472-4b0d-9375-864f11fcad0f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:14.525991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:14.526438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:14.527204 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:14.527640 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:14.541173 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f HTTP/1.1 May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:14.542808 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.544390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '37a76501-1472-4b0d-9375-864f11fcad0f'} May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:14.545306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. May 24 14:07:14.546580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:14.548035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 37a76501-1472-4b0d-9375-864f11fcad0f could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:14.548035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fe6c42a2-b3c0-4376-a92b-fa833b683d69 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f" status: 404 len: 111 microversion: 2.1 time: 0.030041 May 24 14:07:14.548035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 409/821] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:14 2022] GET /compute/v2.1/servers/37a76501-1472-4b0d-9375-864f11fcad0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:15.210731 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:15.211490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:15.226019 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.227503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.229076 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.229809 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.259478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:07:15.280616 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-bf3db3cd-f83e-429c-9053-94439fe0fca5 req-a0304229-4bd2-4e8a-9bdd-e198d3d260be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50e64ca-9602-4aeb-a5fe-17c3969764d1", "tag": "b3254324-4c15-407e-9543-03ad6753b3e9"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:15.289110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-bf3db3cd-f83e-429c-9053-94439fe0fca5 req-a0304229-4bd2-4e8a-9bdd-e198d3d260be service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.289707 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-bf3db3cd-f83e-429c-9053-94439fe0fca5 req-a0304229-4bd2-4e8a-9bdd-e198d3d260be service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.303487 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-bf3db3cd-f83e-429c-9053-94439fe0fca5 req-a0304229-4bd2-4e8a-9bdd-e198d3d260be service nova] Creating event network-changed:b3254324-4c15-407e-9543-03ad6753b3e9 for instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 on hv-cinder-84212 May 24 14:07:15.309743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-bf3db3cd-f83e-429c-9053-94439fe0fca5 req-a0304229-4bd2-4e8a-9bdd-e198d3d260be service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095797 May 24 14:07:15.310478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 410/822] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:15.351175 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fcf273eb-b678-4e89-b728-cf24458559d7 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 204 len: 0 microversion: 2.1 time: 0.144523 May 24 14:07:15.353429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 413/823] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:15 2022] DELETE /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:07:15.362145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:15.363181 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:15.371515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.372096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.373152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.373942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.517623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:15.525814 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fd5036cd-24b5-401b-ab09-241d9c0d44df tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1575 microversion: 2.1 time: 0.168097 May 24 14:07:15.526433 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 411/824] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:15 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:15.691012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:15.691601 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:15.698517 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.698971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.699742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.700202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.713502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b HTTP/1.1 May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:15.715158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.716569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '7cc2ee53-7340-4ef8-9fde-e631f1123d1b'} May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:15.717299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.718621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.720121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:15.720121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b8f4c329-039a-476c-a927-1b4c696fea59 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 404 len: 111 microversion: 2.1 time: 0.029780 May 24 14:07:15.720121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 414/825] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:15 2022] DELETE /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:15.725333 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:15.726034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 7cc2ee53-7340-4ef8-9fde-e631f1123d1b] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:15.732218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.732670 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.733438 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.733880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.750089 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b HTTP/1.1 May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:15.751811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.753377 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '7cc2ee53-7340-4ef8-9fde-e631f1123d1b'} May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:15.754208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. May 24 14:07:15.755697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.757028 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 7cc2ee53-7340-4ef8-9fde-e631f1123d1b could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:15.757028 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-80a7aff2-93ff-4251-b09c-2bc445bd7d3c tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b" status: 404 len: 111 microversion: 2.1 time: 0.031747 May 24 14:07:15.757028 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 412/826] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:15 2022] GET /compute/v2.1/servers/7cc2ee53-7340-4ef8-9fde-e631f1123d1b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:15.762833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:15.763342 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:15.769341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.769796 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.770561 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.771004 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.785162 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 HTTP/1.1 May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:15.786695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.788362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '840693fa-71a3-4a35-8979-596bfcc1aa86'} May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:15.789139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.790525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:15.792624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:15.792624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7aaf7490-b68f-4742-bdc0-52917dd84650 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 404 len: 111 microversion: 2.1 time: 0.029495 May 24 14:07:15.792624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 415/827] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:15 2022] DELETE /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:15.797440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:15.798192 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 840693fa-71a3-4a35-8979-596bfcc1aa86] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:15.804329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.804856 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.805694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:15.806728 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:15.819973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 HTTP/1.1 May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:15.821519 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.823873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '840693fa-71a3-4a35-8979-596bfcc1aa86'} May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:15.824800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. May 24 14:07:15.826260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:15.827578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 840693fa-71a3-4a35-8979-596bfcc1aa86 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:15.827578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cd4ef2b3-dc33-47e2-bd17-cf0e83d18a20 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86" status: 404 len: 111 microversion: 2.1 time: 0.029828 May 24 14:07:15.827578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 413/828] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:15 2022] GET /compute/v2.1/servers/840693fa-71a3-4a35-8979-596bfcc1aa86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:16.543965 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:16.544582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:16.550650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:16.551083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:16.551871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:16.552307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:16.687086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:16.694562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-18b759be-d2d1-4008-a246-c8e3d1a3bcda tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1575 microversion: 2.1 time: 0.154506 May 24 14:07:16.695155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 416/829] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:16 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:16.959542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:16.960076 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:16.966941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:16.967396 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:16.968248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:16.968687 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:16.982284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 HTTP/1.1 May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:16.983803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:16.985364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '9302a225-a5b2-456b-97ef-a6c329608645'} May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:16.986254 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:16.987690 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:16.989421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:16.989421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-11e198e4-e16d-4cca-bcfc-8a90073f4ed8 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 404 len: 111 microversion: 2.1 time: 0.029532 May 24 14:07:16.989421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 414/830] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:16 2022] DELETE /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:16.993528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:16.994805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] [instance: 9302a225-a5b2-456b-97ef-a6c329608645] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:17.001467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:17.001916 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:17.002685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:17.003112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:17.016092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] HTTP exception thrown: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Request method failure captured: May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 HTTP/1.1 May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOPetpXK3UtPGrRQM9nQJM-FbJ47mktQx4jAi9nN072nTcjqs541nF0LVDSrg6Z1uAHbmCv5fcGiQDSvA9_zwPFun7wZfLj2-Y2556Q1OeKMMa2DI7C1Hchp5lkCI_3v61GhqQfQxzsQ0P6tY_KSexfPVjW7T0eGuv4L9VW3oHpdbpQ May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:17.017581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3db44af3db3441b7a0c5eb524eb35806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 3db44af3db3441b7a0c5eb524eb35806 May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-534782043 May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3eb0459bdac1456a900046e264835a6c May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeNegativeTest-534782043-project May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:17.019119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '9302a225-a5b2-456b-97ef-a6c329608645'} May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:17.020388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. May 24 14:07:17.021795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:17.023235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] Returning 404 to user: Instance 9302a225-a5b2-456b-97ef-a6c329608645 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:17.023235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-632fb156-572b-4658-9673-4a36ae9cd7f3 tempest-AttachVolumeNegativeTest-534782043 tempest-AttachVolumeNegativeTest-534782043-project] 10.222.0.24 "GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645" status: 404 len: 111 microversion: 2.1 time: 0.029318 May 24 14:07:17.023235 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 417/831] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:16 2022] GET /compute/v2.1/servers/9302a225-a5b2-456b-97ef-a6c329608645 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:17.712469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:17.713107 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:17.718977 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:17.719426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:17.720214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:17.720649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.033500 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:18.042739 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6717ae5d-f5b0-4903-823b-a4edb509c366 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1456 microversion: 2.1 time: 0.334070 May 24 14:07:18.043489 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 415/832] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:17 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1456 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:18.231261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-b2c12d4c-7fbb-400a-91d6-e33b5a6ec0b5 req-c27d4c7a-b6c2-4330-81fd-f4b6efd1be76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50e64ca-9602-4aeb-a5fe-17c3969764d1", "name": "network-vif-deleted", "tag": "b3254324-4c15-407e-9543-03ad6753b3e9"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:18.243498 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b2c12d4c-7fbb-400a-91d6-e33b5a6ec0b5 req-c27d4c7a-b6c2-4330-81fd-f4b6efd1be76 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.244882 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-b2c12d4c-7fbb-400a-91d6-e33b5a6ec0b5 req-c27d4c7a-b6c2-4330-81fd-f4b6efd1be76 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.258667 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-b2c12d4c-7fbb-400a-91d6-e33b5a6ec0b5 req-c27d4c7a-b6c2-4330-81fd-f4b6efd1be76 service nova] Creating event network-vif-deleted:b3254324-4c15-407e-9543-03ad6753b3e9 for instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 on hv-cinder-84212 May 24 14:07:18.267383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-b2c12d4c-7fbb-400a-91d6-e33b5a6ec0b5 req-c27d4c7a-b6c2-4330-81fd-f4b6efd1be76 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040371 May 24 14:07:18.268754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 418/833] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:18.298619 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:18.300334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:18.309761 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.310286 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.316119 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.316589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.346261 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2b0cecbf-7670-4fbd-b81d-6405e782f2d9 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054253 May 24 14:07:18.346818 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 416/834] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 24 14:07:18 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:18.406589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:18.407181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:18.413400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.413848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.414610 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.415050 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.442251 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:07:18.560797 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3a4ac5c0-2b61-4d3d-996d-4e11c8f2daf2 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 204 len: 0 microversion: 2.20 time: 0.158142 May 24 14:07:18.561486 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 419/835] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 24 14:07:18 2022] DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 14:07:18.570653 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:18.571367 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:18.578285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.578826 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:18.579874 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:18.580393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:19.061565 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:19.062937 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:19.069110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:19.069563 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:19.070325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:19.070762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:19.079422 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:19.088381 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:19.090263 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:19.091620 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-388c555b-f161-4481-8b21-2e1d0ee52cf1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.525434 May 24 14:07:19.092369 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 417/836] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:07:18 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 14:07:19.101548 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:19.101994 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:19.102439 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lazy-loading 'fault' on Instance uuid b50e64ca-9602-4aeb-a5fe-17c3969764d1 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:07:19.146352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:19.154486 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-830c9589-0879-4aa2-a685-0dda012522c1 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 200 len: 1228 microversion: 2.1 time: 0.097122 May 24 14:07:19.155066 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 420/837] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:19 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 1228 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:07:20.111880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:20.112493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:20.123779 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:20.127760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:20.128809 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:20.129419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:20.180352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:20.181302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: b50e64ca-9602-4aeb-a5fe-17c3969764d1] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:20.194931 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:20.201476 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:20.202377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:20.219915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:20.236275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] HTTP exception thrown: Instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 could not be found. May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Request method failure captured: May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 HTTP/1.1 May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijORbeX6MQPDdUtMnNIV45pRouMn9EHpkWgowiJhiRiPlODMlY4x40paUiOS_waWf0sI6pv_ZurzK0m6m1dLV3RwISA41imYHcdgsKODj0WksMXMOqH3OfEVvMNHYnTzpNYcfYRHarmkCDZ7x9lrK0cgwW_qi1u76SKputTV_3vvR43A May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:20.238940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3acb774848a74e74a5886ee681ed205c May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 could not be found. May 24 14:07:20.240360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': 'b50e64ca-9602-4aeb-a5fe-17c3969764d1'} May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 could not be found. May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:20.241121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 could not be found. May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 could not be found. May 24 14:07:20.242350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:20.245160 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Returning 404 to user: Instance b50e64ca-9602-4aeb-a5fe-17c3969764d1 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:20.246279 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-81f482d5-8395-4e40-b425-1657e3b49f41 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1" status: 404 len: 111 microversion: 2.1 time: 0.072124 May 24 14:07:20.247508 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 421/838] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:20 2022] GET /compute/v2.1/servers/b50e64ca-9602-4aeb-a5fe-17c3969764d1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:20.386843 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:20.398687 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:20.401448 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:20.402641 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-47473fae-faed-46c0-9acb-b1503f75f31e tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1723 microversion: 2.20 time: 0.296421 May 24 14:07:20.411948 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 418/839] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:07:20 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:07:21.209536 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-42ceeb3a-5612-4233-b225-8a9a0cfe9f07 req-d6a9c749-622e-437c-a1c8-e222b1af9458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762edbfc-761c-41c1-9404-8936a3869671", "name": "network-vif-deleted", "tag": "dce5d6fb-7321-4b36-8335-7b79a2352887"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:21.223398 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-42ceeb3a-5612-4233-b225-8a9a0cfe9f07 req-d6a9c749-622e-437c-a1c8-e222b1af9458 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:21.224491 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-42ceeb3a-5612-4233-b225-8a9a0cfe9f07 req-d6a9c749-622e-437c-a1c8-e222b1af9458 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:21.249630 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-42ceeb3a-5612-4233-b225-8a9a0cfe9f07 req-d6a9c749-622e-437c-a1c8-e222b1af9458 service nova] Creating event network-vif-deleted:dce5d6fb-7321-4b36-8335-7b79a2352887 for instance 762edbfc-761c-41c1-9404-8936a3869671 on hv-cinder-84212 May 24 14:07:21.264065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-42ceeb3a-5612-4233-b225-8a9a0cfe9f07 req-d6a9c749-622e-437c-a1c8-e222b1af9458 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061928 May 24 14:07:21.265246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 422/840] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:21.420956 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:21.421585 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:21.433621 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:21.434078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:21.434870 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:21.435777 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:21.508495 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:21.509939 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:21.513198 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lazy-loading 'fault' on Instance uuid 762edbfc-761c-41c1-9404-8936a3869671 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:07:21.575479 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:21.585199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:21.586928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b3560616f4ec496f816602f9c73b69ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ebc40e12384ce4bb168690cfd5a27a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:21.589577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-819b7d49-3614-4f8e-b1e5-11a0108507e8 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 200 len: 1371 microversion: 2.20 time: 0.172932 May 24 14:07:21.591114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 419/841] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:07:21 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 14:07:22.609652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:22.610492 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:22.619570 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:22.621176 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:22.622194 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:22.622839 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:22.639518 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] HTTP exception thrown: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Request method failure captured: May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 HTTP/1.1 May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOQt3Cu3yq_7gXtJJzsSqHqvixRlaEzF2Ha6WExNyXBysAzBwWlCh8C88mfjVv0eyvBvWcFDveUX77oR8ozOqhmeAq8dXxOK-ZRhWpX2l8zupnT2WGc_-n3LutLm7-ftL9Oh4LFIolhLxdygM-UyadeGHiBCNIM9X23sD-5tiTvgu4k May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Openstack-Nova-Api-Version: 2.20 May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:22.641458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: b3560616f4ec496f816602f9c73b69ef May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:22.642919 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '762edbfc-761c-41c1-9404-8936a3869671'} May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:22.644028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:22.645325 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:22.648481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Returning 404 to user: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:22.649837 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2938e091-01d4-4ff2-9917-fed83aa222c1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 404 len: 111 microversion: 2.20 time: 0.044511 May 24 14:07:22.650951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 423/842] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:07:22 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 14:07:22.660037 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ad8c3428-cbfd-48c8-879b-e383f7100fe4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '.version_select at 0x7f33b58bdaf0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:22.688102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ad8c3428-cbfd-48c8-879b-e383f7100fe4 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363967137" status: 204 len: 0 microversion: 2.20 time: 0.031568 May 24 14:07:22.689237 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 420/843] 10.222.0.24 () {60 vars in 1261 bytes} [Tue May 24 14:07:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363967137 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 14:07:23.598252 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7b3c0207-6cf8-4754-ae99-401b4db7e3fd req-ed9c7290-dd5b-4827-a0fb-e46f2e2a6be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718e90d7-f726-442e-b00a-5289fb2558de", "tag": "992b9bb4-a542-4387-82ba-0758b4b5ebb0"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:23.599799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:23.604695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:23.616789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:23.618046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:23.621155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:23.621464 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:23.625380 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7b3c0207-6cf8-4754-ae99-401b4db7e3fd req-ed9c7290-dd5b-4827-a0fb-e46f2e2a6be9 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:23.625832 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7b3c0207-6cf8-4754-ae99-401b4db7e3fd req-ed9c7290-dd5b-4827-a0fb-e46f2e2a6be9 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:23.649539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7b3c0207-6cf8-4754-ae99-401b4db7e3fd req-ed9c7290-dd5b-4827-a0fb-e46f2e2a6be9 service nova] Creating event network-changed:992b9bb4-a542-4387-82ba-0758b4b5ebb0 for instance 718e90d7-f726-442e-b00a-5289fb2558de on hv-cinder-84212 May 24 14:07:23.661659 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7b3c0207-6cf8-4754-ae99-401b4db7e3fd req-ed9c7290-dd5b-4827-a0fb-e46f2e2a6be9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065558 May 24 14:07:23.667044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:23.668160 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 421/844] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:23.673401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:07:23.816558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ca845fde-9ac2-4188-849c-41750d057450 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "DELETE /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 204 len: 0 microversion: 2.1 time: 0.225572 May 24 14:07:23.819868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 424/845] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:23 2022] DELETE /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:07:23.827654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:23.828602 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:23.838993 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:23.839567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:23.841171 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:23.841171 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:24.097303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:07:24.097562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:07:24.125970 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:24.131389 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:24.138154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-add5420b-b694-4d78-aa1b-ca648f0db6f2 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1577 microversion: 2.1 time: 0.315756 May 24 14:07:24.139023 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 422/846] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:23 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1577 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:24.526680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:24.530177 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:24.544119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:24.544777 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:24.545681 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:24.546210 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:24.575968 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] HTTP exception thrown: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Request method failure captured: May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 HTTP/1.1 May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOQt3Cu3yq_7gXtJJzsSqHqvixRlaEzF2Ha6WExNyXBysAzBwWlCh8C88mfjVv0eyvBvWcFDveUX77oR8ozOqhmeAq8dXxOK-ZRhWpX2l8zupnT2WGc_-n3LutLm7-ftL9Oh4LFIolhLxdygM-UyadeGHiBCNIM9X23sD-5tiTvgu4k May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Openstack-Nova-Api-Version: 2.20 May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:24.579231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: b3560616f4ec496f816602f9c73b69ef May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.581479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '762edbfc-761c-41c1-9404-8936a3869671'} May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:24.582559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.584064 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:24.585564 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Returning 404 to user: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:24.585564 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-86ed4aa1-9808-40cf-8eec-dc8442507083 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 404 len: 111 microversion: 2.20 time: 0.059951 May 24 14:07:24.586562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 425/847] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 24 14:07:24 2022] DELETE /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 14:07:24.596145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:24.596892 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 762edbfc-761c-41c1-9404-8936a3869671] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:24.606417 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:24.606880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:24.608056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:24.608511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:24.627539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] HTTP exception thrown: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Request method failure captured: May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 HTTP/1.1 May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOQt3Cu3yq_7gXtJJzsSqHqvixRlaEzF2Ha6WExNyXBysAzBwWlCh8C88mfjVv0eyvBvWcFDveUX77oR8ozOqhmeAq8dXxOK-ZRhWpX2l8zupnT2WGc_-n3LutLm7-ftL9Oh4LFIolhLxdygM-UyadeGHiBCNIM9X23sD-5tiTvgu4k May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:24.629266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: b3560616f4ec496f816602f9c73b69ef May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.630720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '762edbfc-761c-41c1-9404-8936a3869671'} May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:24.631453 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. May 24 14:07:24.632694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:24.638146 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Returning 404 to user: Instance 762edbfc-761c-41c1-9404-8936a3869671 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:24.639638 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3353c132-f551-4402-ac1b-cf3ef3ff412f tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671" status: 404 len: 111 microversion: 2.20 time: 0.048101 May 24 14:07:24.644485 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 423/848] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:07:24 2022] GET /compute/v2.1/servers/762edbfc-761c-41c1-9404-8936a3869671 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 14:07:25.083133 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-81eb083a-5718-4463-8c51-adab9b1f787d req-5d44b9f6-4c24-4fd5-a5fd-0f272068a61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718e90d7-f726-442e-b00a-5289fb2558de", "name": "network-vif-deleted", "tag": "992b9bb4-a542-4387-82ba-0758b4b5ebb0"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:25.094984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-81eb083a-5718-4463-8c51-adab9b1f787d req-5d44b9f6-4c24-4fd5-a5fd-0f272068a61d service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.095490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-81eb083a-5718-4463-8c51-adab9b1f787d req-5d44b9f6-4c24-4fd5-a5fd-0f272068a61d service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.109991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-81eb083a-5718-4463-8c51-adab9b1f787d req-5d44b9f6-4c24-4fd5-a5fd-0f272068a61d service nova] Creating event network-vif-deleted:992b9bb4-a542-4387-82ba-0758b4b5ebb0 for instance 718e90d7-f726-442e-b00a-5289fb2558de on hv-cinder-84212 May 24 14:07:25.115723 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-81eb083a-5718-4463-8c51-adab9b1f787d req-5d44b9f6-4c24-4fd5-a5fd-0f272068a61d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037634 May 24 14:07:25.116612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 426/849] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:07:25.156854 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:25.157534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:25.168238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.169020 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.170548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.171236 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.242574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3acb774848a74e74a5886ee681ed205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb15f1d3e524d67b5493cb483ee8547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:25.252141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5e5c4221-b683-4dc2-9ea7-d2e718ea9aec tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 200 len: 1225 microversion: 2.1 time: 0.099263 May 24 14:07:25.252871 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 424/850] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:25 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:25.864594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:25.865236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:25.872171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.872605 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.873371 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.874044 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.889722 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] HTTP exception thrown: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Request method failure captured: May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 HTTP/1.1 May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOQt3Cu3yq_7gXtJJzsSqHqvixRlaEzF2Ha6WExNyXBysAzBwWlCh8C88mfjVv0eyvBvWcFDveUX77oR8ozOqhmeAq8dXxOK-ZRhWpX2l8zupnT2WGc_-n3LutLm7-ftL9Oh4LFIolhLxdygM-UyadeGHiBCNIM9X23sD-5tiTvgu4k May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Openstack-Nova-Api-Version: 2.20 May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:25.891359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: b3560616f4ec496f816602f9c73b69ef May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.892951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '7359d8e4-b8a7-4219-903d-71ea9f7a9292'} May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:25.893684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.894880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:25.896810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Returning 404 to user: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:25.896810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fabd2ad1-771a-46c4-8e02-5a9562f5f377 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 404 len: 111 microversion: 2.20 time: 0.032888 May 24 14:07:25.896810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 427/851] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 24 14:07:25 2022] DELETE /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 14:07:25.902184 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:25.902826 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] [instance: 7359d8e4-b8a7-4219-903d-71ea9f7a9292] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:25.909116 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.909564 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.910335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:25.910771 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:25.924406 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] HTTP exception thrown: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Request method failure captured: May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 HTTP/1.1 May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOQt3Cu3yq_7gXtJJzsSqHqvixRlaEzF2Ha6WExNyXBysAzBwWlCh8C88mfjVv0eyvBvWcFDveUX77oR8ozOqhmeAq8dXxOK-ZRhWpX2l8zupnT2WGc_-n3LutLm7-ftL9Oh4LFIolhLxdygM-UyadeGHiBCNIM9X23sD-5tiTvgu4k May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:25.925968 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d3ebc40e12384ce4bb168690cfd5a27a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: d3ebc40e12384ce4bb168690cfd5a27a May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1809879434 May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: b3560616f4ec496f816602f9c73b69ef May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1809879434-project May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.927342 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '7359d8e4-b8a7-4219-903d-71ea9f7a9292'} May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:25.928193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. May 24 14:07:25.929350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:25.930410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] Returning 404 to user: Instance 7359d8e4-b8a7-4219-903d-71ea9f7a9292 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:25.930410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d0e8e3ed-ac23-4f5b-8388-a9ee20053ae1 tempest-AttachVolumeShelveTestJSON-1809879434 tempest-AttachVolumeShelveTestJSON-1809879434-project] 10.222.0.24 "GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292" status: 404 len: 111 microversion: 2.20 time: 0.029715 May 24 14:07:25.930852 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 425/852] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 24 14:07:25 2022] GET /compute/v2.1/servers/7359d8e4-b8a7-4219-903d-71ea9f7a9292 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 14:07:26.269836 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:26.270642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 718e90d7-f726-442e-b00a-5289fb2558de] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:26.278513 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:26.279086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:26.279970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:26.280407 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:26.294700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] HTTP exception thrown: Instance 718e90d7-f726-442e-b00a-5289fb2558de could not be found. May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Request method failure captured: May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de HTTP/1.1 May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijORbeX6MQPDdUtMnNIV45pRouMn9EHpkWgowiJhiRiPlODMlY4x40paUiOS_waWf0sI6pv_ZurzK0m6m1dLV3RwISA41imYHcdgsKODj0WksMXMOqH3OfEVvMNHYnTzpNYcfYRHarmkCDZ7x9lrK0cgwW_qi1u76SKputTV_3vvR43A May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:26.296426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3acb774848a74e74a5886ee681ed205c May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 718e90d7-f726-442e-b00a-5289fb2558de could not be found. May 24 14:07:26.298021 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '718e90d7-f726-442e-b00a-5289fb2558de'} May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 718e90d7-f726-442e-b00a-5289fb2558de could not be found. May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:26.298927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 718e90d7-f726-442e-b00a-5289fb2558de could not be found. May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 718e90d7-f726-442e-b00a-5289fb2558de could not be found. May 24 14:07:26.300431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.301710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Returning 404 to user: Instance 718e90d7-f726-442e-b00a-5289fb2558de could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:26.301710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3ea8f56d-a7f2-4dd6-990d-d6be3f5c0fad tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de" status: 404 len: 111 microversion: 2.1 time: 0.032706 May 24 14:07:26.301710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 428/853] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:26 2022] GET /compute/v2.1/servers/718e90d7-f726-442e-b00a-5289fb2558de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:26.796354 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:26.797498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:26.804319 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:26.805038 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:26.805919 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:26.807459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:26.822647 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] HTTP exception thrown: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Request method failure captured: May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 HTTP/1.1 May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijORbeX6MQPDdUtMnNIV45pRouMn9EHpkWgowiJhiRiPlODMlY4x40paUiOS_waWf0sI6pv_ZurzK0m6m1dLV3RwISA41imYHcdgsKODj0WksMXMOqH3OfEVvMNHYnTzpNYcfYRHarmkCDZ7x9lrK0cgwW_qi1u76SKputTV_3vvR43A May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:07:26.824561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 3acb774848a74e74a5886ee681ed205c May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.825844 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '975be349-7e4e-4048-b0e1-471723fa08a0'} May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:26.827067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.828279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:07:26.831302 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Returning 404 to user: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:26.832623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7599a18d-5bd5-4458-892f-ab9b76e4baff tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "DELETE /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 404 len: 111 microversion: 2.1 time: 0.039886 May 24 14:07:26.833378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 426/854] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:07:26 2022] DELETE /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:26.841761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:26.842377 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] [instance: 975be349-7e4e-4048-b0e1-471723fa08a0] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:26.849950 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:26.850403 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:26.851516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:26.851984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:26.866712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] HTTP exception thrown: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Request method failure captured: May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 HTTP/1.1 May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijORbeX6MQPDdUtMnNIV45pRouMn9EHpkWgowiJhiRiPlODMlY4x40paUiOS_waWf0sI6pv_ZurzK0m6m1dLV3RwISA41imYHcdgsKODj0WksMXMOqH3OfEVvMNHYnTzpNYcfYRHarmkCDZ7x9lrK0cgwW_qi1u76SKputTV_3vvR43A May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:07:26.869010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7bb15f1d3e524d67b5493cb483ee8547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: 7bb15f1d3e524d67b5493cb483ee8547 May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-TestVolumeBootPattern-1763825507 May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 3acb774848a74e74a5886ee681ed205c May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-TestVolumeBootPattern-1763825507-project May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.870616 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '975be349-7e4e-4048-b0e1-471723fa08a0'} May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:07:26.871506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. May 24 14:07:26.873006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:07:26.874572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Returning 404 to user: Instance 975be349-7e4e-4048-b0e1-471723fa08a0 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:07:26.874572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c67a79a8-9cef-4bdd-ad73-5dc56a068015 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0" status: 404 len: 111 microversion: 2.1 time: 0.033813 May 24 14:07:26.874572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 429/855] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:26 2022] GET /compute/v2.1/servers/975be349-7e4e-4048-b0e1-471723fa08a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:07:28.360803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4032807a-62bc-4c1b-b0eb-ae19bcd397e8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] Calling method '.version_select at 0x7f33ba9a7820>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:28.393457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4032807a-62bc-4c1b-b0eb-ae19bcd397e8 tempest-TestVolumeBootPattern-1763825507 tempest-TestVolumeBootPattern-1763825507-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-131305348" status: 202 len: 0 microversion: 2.1 time: 0.037725 May 24 14:07:28.394235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 427/856] 10.222.0.24 () {58 vars in 1259 bytes} [Tue May 24 14:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-131305348 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:07:33.291795 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:07:33.292722 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:07:38.242894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:38.244134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:38.431470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-84b365d9-b745-4e3a-be7f-07b402c2be22 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: .version_select at 0x7f33b570b670>, body: {"keypair": {"name": "tempest-keypair-618084728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi+cg3O+Pc8Oj+eFfNQxkM5mhC0DlgByKIcX6HikOjrtjnh9UFXb1ymXWH1KjY0GpHyrrpg4tj0GmKFukQFekMBc4XYuIE/rahp1h3l7KzywIvxJy/hOANeYxeR7X1diA=="}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:38.451057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-84b365d9-b745-4e3a-be7f-07b402c2be22 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for project e436feb329204699a78d749db135acce. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:07:38.455694 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-84b365d9-b745-4e3a-be7f-07b402c2be22 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for user 54fce865bd6842c19583b3bfe607fc32 and project e436feb329204699a78d749db135acce. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:07:38.488826 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-84b365d9-b745-4e3a-be7f-07b402c2be22 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.252326 May 24 14:07:38.489658 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 430/857] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:07:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:39.879778 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=12 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:39.880893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:39.886422 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2070258038", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0876f86-477e-43a6-b89a-5d925c2bd73a"}], "security_groups": [{"name": "tempest-securitygroup--337402102"}], "key_name": "tempest-keypair-618084728", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:40.018827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] validate_networks() for [('d0876f86-477e-43a6-b89a-5d925c2bd73a', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:07:40.690111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:07:40.690720 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:07:40.691516 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:07:40.692148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:07:40.692707 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:07:40.703380 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:40.704102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:40.705111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:40.705709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:40.724848 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for project e436feb329204699a78d749db135acce. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:07:40.730726 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for user 54fce865bd6842c19583b3bfe607fc32 and project e436feb329204699a78d749db135acce. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:07:40.746760 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:07:40.748607 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:07:40.805512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ba2d9f29-4edd-4e69-9e4e-2121de16c92f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.927080 May 24 14:07:40.807240 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 428/858] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:07:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:07:40.822487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-29aba5ca-3b88-4fb9-b966-2a296418125e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:40.823872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-29aba5ca-3b88-4fb9-b966-2a296418125e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:40.911790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-29aba5ca-3b88-4fb9-b966-2a296418125e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:40.923032 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-29aba5ca-3b88-4fb9-b966-2a296418125e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1237 microversion: 2.1 time: 0.105642 May 24 14:07:40.934103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 431/859] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:40 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1237 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:41.941790 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:41.942560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:41.951409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:41.952767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:41.953807 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:41.954882 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:42.041198 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:42.053945 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e24f9375-bc82-45ea-b604-0b51cd80a7ff tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1289 microversion: 2.1 time: 0.116840 May 24 14:07:42.055464 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 429/860] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:41 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:43.074586 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:43.076238 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:43.083691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:43.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:43.085652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:43.086316 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:43.252288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:43.261506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-872aeb4b-5d07-458c-87f9-057da7dfdbbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.192905 May 24 14:07:43.262095 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 432/861] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:43 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:43.706815 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-98b39445-f507-4c22-b256-4c277c9306f2 req-549aded6-dc4d-473a-be14-e1164d7af257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98d1fc5-59b2-4360-ab1b-8154005f26ad", "tag": "4e64fdd4-c3e5-497b-9ca2-29d3b279c477"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:43.736152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-98b39445-f507-4c22-b256-4c277c9306f2 req-549aded6-dc4d-473a-be14-e1164d7af257 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:43.738612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-98b39445-f507-4c22-b256-4c277c9306f2 req-549aded6-dc4d-473a-be14-e1164d7af257 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:43.776989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-98b39445-f507-4c22-b256-4c277c9306f2 req-549aded6-dc4d-473a-be14-e1164d7af257 service nova] Creating event network-changed:4e64fdd4-c3e5-497b-9ca2-29d3b279c477 for instance a98d1fc5-59b2-4360-ab1b-8154005f26ad on hv-cinder-84212 May 24 14:07:43.795039 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-98b39445-f507-4c22-b256-4c277c9306f2 req-549aded6-dc4d-473a-be14-e1164d7af257 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094881 May 24 14:07:43.796293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 430/862] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:44.278424 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:44.279038 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:44.285742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:44.286192 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:44.287017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:44.287389 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:44.430163 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:44.438515 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-42130ac9-4c3f-48a6-bf35-70bfb8cf62fd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.164208 May 24 14:07:44.439070 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 433/863] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:44 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:45.454882 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:45.455598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:45.463152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:45.463595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:45.464445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:45.464885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:45.606228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:45.614627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f375c833-5f6b-42ae-ba86-52278cbb2332 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.163827 May 24 14:07:45.615284 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 431/864] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:45 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:46.632258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:46.632940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:46.647764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:46.648269 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:46.649051 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:46.649488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:46.790479 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:46.798404 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-31b7a473-b75e-42f1-a3b7-c7d924431bb2 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.170271 May 24 14:07:46.808902 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 434/865] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:46 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:47.815908 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:47.817042 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:47.825782 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:47.826235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:47.827136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:47.827578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:48.012260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:48.020783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f3ecb028-2bdb-4b9e-9cb1-dbec86aedd28 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.208421 May 24 14:07:48.021550 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 432/866] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:47 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:49.039955 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:49.040692 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:49.047146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:49.047598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:49.048390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:49.048878 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:49.182391 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:49.190442 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b3ed5bcd-81ae-40d8-9d52-2a5dc1045afa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.155063 May 24 14:07:49.191093 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 435/867] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:49 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:50.208421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:50.209038 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:50.216167 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:50.216624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:50.217426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:50.217869 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:50.351135 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:50.358491 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6cb9f2f9-1b39-4e71-99b8-64a9bf3042a3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.154068 May 24 14:07:50.359054 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 433/868] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:50 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:50.917521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:50.925727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-0fc51f4c-e118-4c1e-80f9-e1fec5fff793 req-3c445646-ba8d-4ab6-bead-049798416f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98d1fc5-59b2-4360-ab1b-8154005f26ad", "name": "network-vif-plugged", "status": "completed", "tag": "4e64fdd4-c3e5-497b-9ca2-29d3b279c477"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:50.934737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0fc51f4c-e118-4c1e-80f9-e1fec5fff793 req-3c445646-ba8d-4ab6-bead-049798416f4d service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:50.935179 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0fc51f4c-e118-4c1e-80f9-e1fec5fff793 req-3c445646-ba8d-4ab6-bead-049798416f4d service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:50.947603 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-0fc51f4c-e118-4c1e-80f9-e1fec5fff793 req-3c445646-ba8d-4ab6-bead-049798416f4d service nova] Creating event network-vif-plugged:4e64fdd4-c3e5-497b-9ca2-29d3b279c477 for instance a98d1fc5-59b2-4360-ab1b-8154005f26ad on hv-cinder-84212 May 24 14:07:50.952567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-0fc51f4c-e118-4c1e-80f9-e1fec5fff793 req-3c445646-ba8d-4ab6-bead-049798416f4d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165706 May 24 14:07:50.953136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 436/869] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:51.376189 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:51.376861 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:51.378772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:51.379461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:07:51.386310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:51.386767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:51.387565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:51.388041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:51.533804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:51.542388 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-17e58795-f9dd-445c-9bfe-8491dd219430 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.170340 May 24 14:07:51.542948 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 434/870] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:51 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:52.560331 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:52.561077 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:52.567220 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:52.567670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:52.568460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:52.568898 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:52.699338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:52.699941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:52.704406 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:52.706207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:52.706662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:52.707444 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:52.707981 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:52.712058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2dab1c8f-d3d5-4dc0-8782-90a1467dec71 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1362 microversion: 2.1 time: 0.157070 May 24 14:07:52.712724 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 437/871] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:52 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:52.733008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lazy-loading 'flavor' on Instance uuid 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:07:52.845504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-49594aac-456c-4ae2-8848-413bbbc4c45b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "POST /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857/action" status: 202 len: 0 microversion: 2.1 time: 0.149312 May 24 14:07:52.846239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 435/872] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:07:52 2022] POST /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 14:07:52.855965 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:52.856655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:52.862629 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:52.863078 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:52.863856 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:52.864296 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:53.008259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:53.016652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cd8521b0-c7f4-4e27-8ad0-4f8517d7ea71 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.165365 May 24 14:07:53.017233 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 438/873] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:52 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:53.730534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:53.731303 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:53.737697 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:53.738154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:53.738937 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:53.739421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:53.878530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:53.887124 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fbfa364c-f741-45de-a530-f42d4610cdbd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1547 microversion: 2.1 time: 0.161777 May 24 14:07:53.887740 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 436/874] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:53 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:53.903611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:53.904191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:53.910649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:53.911093 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:53.911878 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:53.912313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:53.991400 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-23a10e5c-6c39-4b56-b2f2-e6ed7c023523 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091856 May 24 14:07:53.992040 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 439/875] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 14:07:53 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:54.034780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:54.035501 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:54.042695 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:54.043252 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:54.044151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:54.044688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:54.181457 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:54.189911 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f6bef57e-9688-42e0-a5dd-226a4321c84e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.159029 May 24 14:07:54.201162 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 437/876] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:54 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:54.943250 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-dfc303d7-d9fb-44e3-9ae4-d20d64347887 req-cc2a9dbb-3f10-4e87-9dd7-3518968bd718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98d1fc5-59b2-4360-ab1b-8154005f26ad", "tag": "4e64fdd4-c3e5-497b-9ca2-29d3b279c477"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:07:54.951427 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-dfc303d7-d9fb-44e3-9ae4-d20d64347887 req-cc2a9dbb-3f10-4e87-9dd7-3518968bd718 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:54.951896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-dfc303d7-d9fb-44e3-9ae4-d20d64347887 req-cc2a9dbb-3f10-4e87-9dd7-3518968bd718 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:54.962680 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-dfc303d7-d9fb-44e3-9ae4-d20d64347887 req-cc2a9dbb-3f10-4e87-9dd7-3518968bd718 service nova] Creating event network-changed:4e64fdd4-c3e5-497b-9ca2-29d3b279c477 for instance a98d1fc5-59b2-4360-ab1b-8154005f26ad on hv-cinder-84212 May 24 14:07:54.968199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-dfc303d7-d9fb-44e3-9ae4-d20d64347887 req-cc2a9dbb-3f10-4e87-9dd7-3518968bd718 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029942 May 24 14:07:54.968741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 440/877] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:07:55.209564 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:55.217442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:55.223637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:55.224320 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:55.225114 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:55.225536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:55.465419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:55.473570 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5bda5bc5-4ca7-44a4-9bbf-4bc519239599 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.268613 May 24 14:07:55.474355 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 438/878] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:55 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:56.492960 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:56.493660 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:56.501446 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:56.502056 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:56.502850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:56.503293 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:56.637676 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:56.645255 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-88e93c3c-97ef-49c9-9fd4-212a1ed815e3 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.157049 May 24 14:07:56.645821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 441/879] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:56 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:57.662627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:57.663240 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:57.670488 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:57.670961 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:57.671954 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:57.672488 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:57.806446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:57.814793 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-172a1029-0ebb-4c66-b59c-e40e0af94379 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.155942 May 24 14:07:57.815357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 439/880] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:57 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:07:58.832096 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:07:58.832702 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:07:58.839228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:58.839703 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:58.840605 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:07:58.841040 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:07:58.975458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:07:58.983137 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-45b54c3d-e27f-4eda-a4c9-6ca3767cab6b tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.154858 May 24 14:07:58.983708 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 442/881] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:58 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:00.001048 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:00.001649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:00.008213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:00.008680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:00.009442 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:00.009876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:00.145437 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:00.154223 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d225acba-dda0-4324-a064-42487ac42f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.158869 May 24 14:08:00.154798 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 440/882] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:07:59 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:01.172024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:01.172574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:01.178988 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:01.179426 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:01.180203 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:01.180632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:01.307218 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:01.314716 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-149213d9-dd69-44e4-bc3c-5b6d21d58238 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.147365 May 24 14:08:01.315286 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 443/883] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:01 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:02.332248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:02.332856 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:02.339552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:02.340048 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:02.340812 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:02.341247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:02.470766 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:02.478136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a3b2596-c695-4094-8ed1-9fa1f30d63d4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.149817 May 24 14:08:02.478705 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 441/884] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:02 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:03.496462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:03.497202 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:03.503972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:03.504425 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:03.505200 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:03.505634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:03.643361 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:03.650862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e58c2944-bb11-47e9-9309-86bcb6a6eb2f tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.158779 May 24 14:08:03.651429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 444/885] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:03 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:04.667979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:04.668589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:04.675256 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:04.675700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:04.676490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:04.676923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:04.807481 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:04.815767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4cc3cb64-4b5f-46a3-8069-6f456b818f82 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.151729 May 24 14:08:04.816350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 442/886] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:04 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:05.833652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:05.834226 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:05.841272 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:05.841805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:05.842564 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:05.842998 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:05.977894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:05.986569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8bd2b7a9-8ee5-440b-910b-0148c994e639 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1570 microversion: 2.1 time: 0.156828 May 24 14:08:05.987146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 445/887] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:05 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:06.003321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:06.003937 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:06.010317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:06.010757 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:06.011512 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:06.011973 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:06.046672 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:06.091238 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-073925fe-8cb7-4ccb-b629-c94979e51d08 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "POST /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857/action" status: 202 len: 0 microversion: 2.1 time: 0.091485 May 24 14:08:06.091741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 443/888] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:08:05 2022] POST /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:08:06.099710 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:06.100339 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:06.106179 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:06.107292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:06.108073 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:06.108507 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:06.237717 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:06.245737 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-17bafaf7-7991-48ba-ba57-9decd4e9e4a1 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1518 microversion: 2.1 time: 0.149464 May 24 14:08:06.245966 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 446/889] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:06 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:07.264257 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:07.264873 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:07.270849 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:07.271295 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:07.272081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:07.272518 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:07.440446 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:07.448070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b84913b6-af32-46dc-88b9-cf1a9a486acb tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.188417 May 24 14:08:07.448642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 444/890] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:07 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:08.465547 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:08.466140 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:08.469423 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:08.476181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:08.476623 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:08.477387 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:08.478334 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:08.484118 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=81 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:08.619670 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:08.628528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-15e23fb7-61d1-4034-a777-29b21edc6644 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.166771 May 24 14:08:08.629095 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 447/891] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:08 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:08.825232 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-19499eaf-8ce2-47cf-9107-f1538276f514 req-1bab9903-e7ee-4466-ac50-4ce6d3a81859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "name": "network-vif-unplugged", "status": "completed", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:08.835133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-19499eaf-8ce2-47cf-9107-f1538276f514 req-1bab9903-e7ee-4466-ac50-4ce6d3a81859 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:08.835586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-19499eaf-8ce2-47cf-9107-f1538276f514 req-1bab9903-e7ee-4466-ac50-4ce6d3a81859 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:08.847421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-19499eaf-8ce2-47cf-9107-f1538276f514 req-1bab9903-e7ee-4466-ac50-4ce6d3a81859 service nova] Creating event network-vif-unplugged:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:08:08.852404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-19499eaf-8ce2-47cf-9107-f1538276f514 req-1bab9903-e7ee-4466-ac50-4ce6d3a81859 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031032 May 24 14:08:08.852992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 445/892] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:08:09.702389 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:09.703190 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:09.709522 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:09.709976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:09.710709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:09.711337 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:09.843657 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:09.851911 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-3e935269-c8ac-4033-8c52-f2fd61896c6c tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.154338 May 24 14:08:09.852483 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 448/893] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:09 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:10.870598 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:10.871435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:10.873999 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:10.880046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:10.880455 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:10.881373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:10.881820 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:11.071789 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:11.080220 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2e0a48b1-93e3-4e95-adc0-5416d1d3476e tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.214534 May 24 14:08:11.080980 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 446/894] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:10 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:12.096788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:12.097488 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:12.104310 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:12.104760 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:12.105525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:12.105962 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:12.238842 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:12.246432 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-06e52ed1-275e-4198-8d1a-ad207585a724 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.153706 May 24 14:08:12.247003 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 449/895] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:12 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:13.115194 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2086235122", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "networks": [{"uuid": "eaa2de73-84b5-464d-8625-8db6f7696595"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:13.166222 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] validate_networks() for [('eaa2de73-84b5-464d-8625-8db6f7696595', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:08:13.263992 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:13.265417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:13.271917 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:13.272362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:13.273433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:13.273537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:13.408763 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:13.416826 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d491d39a-283a-494a-b034-88c33cb02ffa tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.156564 May 24 14:08:13.417418 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 450/896] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:13 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:08:13.512161 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:08:13.512583 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:08:13.513086 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:08:13.513490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:08:13.513899 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:08:13.524079 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:13.524522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:13.525311 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:13.525744 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:13.542812 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Getting quotas for project 1dfef898db944127a1407a9be98cac4f. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:08:13.546971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Getting quotas for user 8dd68e21b78f49b09a958415b17f6aa8 and project 1dfef898db944127a1407a9be98cac4f. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:08:13.557576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:08:13.559786 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:08:13.605077 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-431f108a-1de4-4305-9b89-d7377e8d45e7 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493756 May 24 14:08:13.605736 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 447/897] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:08:13.616146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4058f965-7d24-4cdc-9963-109b7cebf429 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:13.616793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4058f965-7d24-4cdc-9963-109b7cebf429 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:13.669588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4058f965-7d24-4cdc-9963-109b7cebf429 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:13.676453 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4058f965-7d24-4cdc-9963-109b7cebf429 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1219 microversion: 2.1 time: 0.064332 May 24 14:08:13.677031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 451/898] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:13 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:14.434646 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:14.435179 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:14.442357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:14.442811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:14.443579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:14.444061 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:14.574413 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:14.581779 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-261714f0-2ac1-444e-b506-e468a2ed418d tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.151185 May 24 14:08:14.582345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 448/899] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:14 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:14.692641 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:14.693192 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:14.702700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:14.703393 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:14.704449 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:14.704894 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:14.764760 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:14.772599 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-45e375b5-93a8-4b7c-9c9d-0ea6341334d8 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1223 microversion: 2.1 time: 0.083905 May 24 14:08:14.773165 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 452/900] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:14 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:15.598785 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:15.599403 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:15.605871 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:15.606326 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:15.607094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:15.607534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:15.739796 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:15.748014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-adc13f25-8d39-474f-b1c4-7401156c91f8 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.153002 May 24 14:08:15.748784 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 449/901] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:15 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:08:15.790129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:15.790741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:15.798501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:15.799253 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:15.800321 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:15.800859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:15.868168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:15.876569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-54cd5a12-dff0-4f63-acc2-8c1ab618e951 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1279 microversion: 2.1 time: 0.090393 May 24 14:08:15.877237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 453/902] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:15 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:16.766635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:16.767168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:16.774290 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:16.774752 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:16.775534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:16.776014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:16.895486 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:16.896194 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:16.902809 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:16.903256 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:16.905016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:16.906105 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:17.026522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:17.045893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d95960b-df72-4d5c-876e-8f96a8cf62d0 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1576 microversion: 2.1 time: 0.281133 May 24 14:08:17.053229 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 450/903] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:16 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:17.071025 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:17.079460 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c4188f45-6a93-4980-ab41-9426dbe7c5df tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.189380 May 24 14:08:17.080320 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 454/904] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:16 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:17.186227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-1552d6e8-0353-4d8c-86f5-d4237fd02dc4 req-7467b63a-06db-48aa-8538-e85ee2b85aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8cba3f-048c-4686-b7d0-58c1afdc8503", "tag": "a4af5bfe-2762-47ed-b06a-0c96ced4d435"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:17.198535 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1552d6e8-0353-4d8c-86f5-d4237fd02dc4 req-7467b63a-06db-48aa-8538-e85ee2b85aec service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:17.199840 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1552d6e8-0353-4d8c-86f5-d4237fd02dc4 req-7467b63a-06db-48aa-8538-e85ee2b85aec service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:17.217838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-1552d6e8-0353-4d8c-86f5-d4237fd02dc4 req-7467b63a-06db-48aa-8538-e85ee2b85aec service nova] Creating event network-changed:a4af5bfe-2762-47ed-b06a-0c96ced4d435 for instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 on hv-cinder-84212 May 24 14:08:17.223625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-1552d6e8-0353-4d8c-86f5-d4237fd02dc4 req-7467b63a-06db-48aa-8538-e85ee2b85aec service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041299 May 24 14:08:17.224581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 451/905] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:08:18.065167 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:18.065780 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:18.072304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:18.072748 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:18.073500 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:18.074028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:18.098364 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:18.099195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:18.105942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:18.106393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:18.107163 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:18.107603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:18.204904 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:18.212367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fa1a7ba0-c47b-4377-b066-d347c1b4b148 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1563 microversion: 2.1 time: 0.151161 May 24 14:08:18.212935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 455/906] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:18 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:18.240548 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:18.248041 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-493e1c20-0511-4455-b085-94ef2d13396d tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.154442 May 24 14:08:18.248610 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 452/907] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:18 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:08:18.958431 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-57322f4e-ff8d-4310-be78-adae9ca78f67 req-817e8bbc-3f1f-421b-b228-51c7a8fb9044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "name": "network-vif-plugged", "status": "completed", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:18.967263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-57322f4e-ff8d-4310-be78-adae9ca78f67 req-817e8bbc-3f1f-421b-b228-51c7a8fb9044 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:18.968646 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-57322f4e-ff8d-4310-be78-adae9ca78f67 req-817e8bbc-3f1f-421b-b228-51c7a8fb9044 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:18.980036 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-57322f4e-ff8d-4310-be78-adae9ca78f67 req-817e8bbc-3f1f-421b-b228-51c7a8fb9044 service nova] Creating event network-vif-plugged:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:08:18.985063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-57322f4e-ff8d-4310-be78-adae9ca78f67 req-817e8bbc-3f1f-421b-b228-51c7a8fb9044 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030886 May 24 14:08:18.985649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 456/908] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:08:19.266050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:19.266653 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:19.273136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:19.273577 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:19.274327 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:19.274756 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:19.400878 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:19.408924 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3c04c0fe-c683-4c95-8410-b0dd11529e33 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.147319 May 24 14:08:19.409498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 453/909] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:19 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:20.426963 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:20.427603 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:20.434814 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:20.435259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:20.436052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:20.436487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:20.579978 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:20.587341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e9aa79d5-e182-4e76-9671-2bb0e55dd85b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.165123 May 24 14:08:20.588150 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 457/910] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:20 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:21.604288 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:21.604831 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:21.611559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:21.612054 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:21.612824 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:21.613265 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:21.740103 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:21.747678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-73e00bf4-3ffb-47e6-932d-fde6b5a49294 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.147410 May 24 14:08:21.748277 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 454/911] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:21 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:22.766227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:22.766787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:22.773330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:22.773785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:22.774574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:22.775017 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:22.907856 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:22.915511 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fd342cd9-bd81-464e-87a8-62dc9eda89cf tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.153540 May 24 14:08:22.916148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 458/912] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:22 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:22.970426 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-8602dba2-0a9d-41d6-8396-1e1c6246d1a4 req-7f024b20-e732-454e-905e-0d8da7246fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8cba3f-048c-4686-b7d0-58c1afdc8503", "name": "network-vif-plugged", "status": "completed", "tag": "a4af5bfe-2762-47ed-b06a-0c96ced4d435"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:22.978509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-8602dba2-0a9d-41d6-8396-1e1c6246d1a4 req-7f024b20-e732-454e-905e-0d8da7246fbc service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:22.979037 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-8602dba2-0a9d-41d6-8396-1e1c6246d1a4 req-7f024b20-e732-454e-905e-0d8da7246fbc service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:22.991130 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-8602dba2-0a9d-41d6-8396-1e1c6246d1a4 req-7f024b20-e732-454e-905e-0d8da7246fbc service nova] Creating event network-vif-plugged:a4af5bfe-2762-47ed-b06a-0c96ced4d435 for instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 on hv-cinder-84212 May 24 14:08:22.995775 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-8602dba2-0a9d-41d6-8396-1e1c6246d1a4 req-7f024b20-e732-454e-905e-0d8da7246fbc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029786 May 24 14:08:22.996392 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 455/913] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:08:23.932946 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:23.933562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:23.935528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:23.941940 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:23.942393 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:23.943148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:23.943582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:24.078131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:24.085530 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8d441e85-da44-4a13-a158-7e931123cbd0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1319 microversion: 2.1 time: 0.156382 May 24 14:08:24.086100 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 459/914] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:23 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:25.099723 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:25.100566 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:25.105768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:08:25.106469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:25.113287 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:25.113740 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:25.114499 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:25.114938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:25.242106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:08:25.249452 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-af897cde-35c2-45a0-bf7d-1936b1eee3d9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1506 microversion: 2.1 time: 0.150743 May 24 14:08:25.251139 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 456/915] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:08:25 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:08:47.706800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "209039f3-1eac-462a-9519-52b355603385", "device": "/dev/sdb"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:08:47.708403 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:08:47.710562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=27 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:47.711249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=67 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:08:47.717328 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:47.717768 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:47.718523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:08:47.718951 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:08:47.962133 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c4a69267-5170-4efc-b949-f4b5110fde61 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "POST /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259822 May 24 14:08:47.962915 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 460/916] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:08:47 2022] POST /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:08:59.570654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:08:59.571229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:09:14.661955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:14.662451 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:14.664714 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:14.665504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:14.672111 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:14.672584 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:14.673345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:14.673777 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:14.759308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lazy-loading 'services' on Instance uuid 3b8cba3f-048c-4686-b7d0-58c1afdc8503 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:09:14.828244 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-586643a3-979b-4a30-90f0-5a4aea146c91 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503/os-volume_attachments/209039f3-1eac-462a-9519-52b355603385" status: 202 len: 0 microversion: 2.1 time: 0.170221 May 24 14:09:14.828856 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 457/917] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:09:14 2022] DELETE /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503/os-volume_attachments/209039f3-1eac-462a-9519-52b355603385 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:09:15.943774 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:15.944577 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:15.949170 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:15.949758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:15.957164 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:15.957611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:15.958495 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:15.958936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:15.993783 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:09:16.069654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f50cad5a-ef2d-47ae-8845-021ee7da625a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 204 len: 0 microversion: 2.1 time: 0.126920 May 24 14:09:16.071058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 461/918] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:09:15 2022] DELETE /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:09:16.080953 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:16.081683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:16.088207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:16.088599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:16.089361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:16.089796 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:16.215624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:16.222935 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3af7dff4-3659-470d-8a55-388ef8e39768 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1512 microversion: 2.1 time: 0.146898 May 24 14:09:16.223498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 458/919] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:16 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:17.242944 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:17.243649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:17.250216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:17.250662 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:17.251429 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:17.251886 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:17.394775 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:17.403581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b665f56e-34f6-41e3-86ad-475ad526c0ab tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1512 microversion: 2.1 time: 0.166128 May 24 14:09:17.404181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 462/920] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:17 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:18.393167 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-cc6b14dd-e822-414b-ae12-624f97483b53 req-f33d3c2f-9643-4f18-b7ac-8bf37e856051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8cba3f-048c-4686-b7d0-58c1afdc8503", "name": "network-vif-deleted", "tag": "a4af5bfe-2762-47ed-b06a-0c96ced4d435"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:09:18.403073 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-cc6b14dd-e822-414b-ae12-624f97483b53 req-f33d3c2f-9643-4f18-b7ac-8bf37e856051 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:18.403517 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-cc6b14dd-e822-414b-ae12-624f97483b53 req-f33d3c2f-9643-4f18-b7ac-8bf37e856051 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:18.419082 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-cc6b14dd-e822-414b-ae12-624f97483b53 req-f33d3c2f-9643-4f18-b7ac-8bf37e856051 service nova] Creating event network-vif-deleted:a4af5bfe-2762-47ed-b06a-0c96ced4d435 for instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 on hv-cinder-84212 May 24 14:09:18.421750 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:18.422370 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:18.425424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-cc6b14dd-e822-414b-ae12-624f97483b53 req-f33d3c2f-9643-4f18-b7ac-8bf37e856051 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036071 May 24 14:09:18.426192 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 459/921] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:09:18.429458 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:18.429909 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:18.430684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:18.431119 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:18.494455 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:18.502753 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-0aceb01a-5338-4055-9f97-1a9e98d899c9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 200 len: 1304 microversion: 2.1 time: 0.085215 May 24 14:09:18.503327 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 463/922] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:18 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:19.520070 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:19.520774 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 3b8cba3f-048c-4686-b7d0-58c1afdc8503] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:19.527669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:19.528152 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:19.528912 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:19.529350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:19.543010 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] HTTP exception thrown: Instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 could not be found. May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Request method failure captured: May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 HTTP/1.1 May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijObLCTLXc85tdQHhxGW4utojxsNesovpl9fCxsTJP2syM3JOzmJoe0D1ruNsGMLGXWiJEPQ7zqTnuP9n251jM4_iNRXOS6lD-9pk4SGlfQYVDeTzNKG4ySyQOdr6JNPFw3uAcs9rxEI_DUbXbryL6Hxsu9NFogYk--eGFTxWDNq0DUg May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 1dfef898db944127a1407a9be98cac4f May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2008450976 May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:09:19.544662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1dfef898db944127a1407a9be98cac4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1dfef898db944127a1407a9be98cac4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1dfef898db944127a1407a9be98cac4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1dfef898db944127a1407a9be98cac4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesSnapshotTestJSON-2008450976 May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 1dfef898db944127a1407a9be98cac4f May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2008450976 May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesSnapshotTestJSON-2008450976-project May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 8dd68e21b78f49b09a958415b17f6aa8 May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesSnapshotTestJSON-2008450976-project May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 could not be found. May 24 14:09:19.546357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '3b8cba3f-048c-4686-b7d0-58c1afdc8503'} May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 could not be found. May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:09:19.547424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 could not be found. May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 could not be found. May 24 14:09:19.549092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:09:19.550605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Returning 404 to user: Instance 3b8cba3f-048c-4686-b7d0-58c1afdc8503 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:09:19.550605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f009d5f1-c633-4b0b-bcf6-f68b3cfd4fc6 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503" status: 404 len: 111 microversion: 2.1 time: 0.030274 May 24 14:09:19.550605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 460/923] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:19 2022] GET /compute/v2.1/servers/3b8cba3f-048c-4686-b7d0-58c1afdc8503 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:09:30.376404 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-307780241", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "networks": [{"uuid": "eaa2de73-84b5-464d-8625-8db6f7696595"}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:09:30.384805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:30.385466 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:30.430652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] validate_networks() for [('eaa2de73-84b5-464d-8625-8db6f7696595', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:09:31.038217 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:09:31.039283 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:09:31.039872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:09:31.040284 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:09:31.040692 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:09:31.051015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:31.051452 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:31.052279 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:31.052709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:31.069557 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Getting quotas for project 1dfef898db944127a1407a9be98cac4f. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:09:31.074385 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Getting quotas for user 8dd68e21b78f49b09a958415b17f6aa8 and project 1dfef898db944127a1407a9be98cac4f. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:09:31.085071 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:09:31.088151 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:09:31.136079 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f120b432-8efc-4bfd-8d24-c34e7569520a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763425 May 24 14:09:31.136739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 464/924] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:09:31.148483 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f9f45a90-ed76-4750-8626-341c407c11f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:31.149298 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f9f45a90-ed76-4750-8626-341c407c11f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:31.151353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=8 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:31.152216 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:31.208857 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f9f45a90-ed76-4750-8626-341c407c11f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:31.216196 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f9f45a90-ed76-4750-8626-341c407c11f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1218 microversion: 2.1 time: 0.072299 May 24 14:09:31.216767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 461/925] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:31 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:09:32.233727 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:32.234515 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:32.245075 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:32.245507 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:32.246268 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:32.246697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:32.309171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:32.317006 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e32b09c3-669e-48c9-8440-c40fee080c54 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1276 microversion: 2.1 time: 0.087850 May 24 14:09:32.317568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 465/926] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:32 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:33.303009 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-dd7f16c3-d096-4f4e-b8bc-7a6b24ae6042 req-311e8c0b-f67d-4662-ac86-3f7acdd2ffa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29eb3d32-4276-4fa6-bc39-db388390a284", "tag": "2ff53749-05a2-4474-b061-4cf3f20a2ba9"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:09:33.314463 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-dd7f16c3-d096-4f4e-b8bc-7a6b24ae6042 req-311e8c0b-f67d-4662-ac86-3f7acdd2ffa0 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:33.314902 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-dd7f16c3-d096-4f4e-b8bc-7a6b24ae6042 req-311e8c0b-f67d-4662-ac86-3f7acdd2ffa0 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:33.326400 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-dd7f16c3-d096-4f4e-b8bc-7a6b24ae6042 req-311e8c0b-f67d-4662-ac86-3f7acdd2ffa0 service nova] Creating event network-changed:2ff53749-05a2-4474-b061-4cf3f20a2ba9 for instance 29eb3d32-4276-4fa6-bc39-db388390a284 on hv-cinder-84212 May 24 14:09:33.331117 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-dd7f16c3-d096-4f4e-b8bc-7a6b24ae6042 req-311e8c0b-f67d-4662-ac86-3f7acdd2ffa0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031938 May 24 14:09:33.331709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 462/927] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:09:33.336612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:33.337227 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:33.343497 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:33.343985 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:33.344763 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:33.345201 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:33.485751 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:33.493405 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-03f3452f-2d6a-4cb1-9dd9-b0e6a6c01c04 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.161268 May 24 14:09:33.494174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 466/928] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:33 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:09:34.511412 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:34.512140 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:34.518315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:34.518769 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:34.519538 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:34.520008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:34.655263 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:34.662590 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5013a3e6-da76-49dd-9bd6-827d91e45dc0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.156325 May 24 14:09:34.663156 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 463/929] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:34 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:35.678591 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:35.679853 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:35.686365 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:35.686806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:35.687552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:35.688012 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:35.814509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:35.822818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d8840389-4792-4eca-89e1-182aa40336e9 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.148105 May 24 14:09:35.823408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 467/930] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:35 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:36.839445 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:36.840067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:36.846498 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:36.846947 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:36.847710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:36.848168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:36.977106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:36.984434 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c2a771b1-e86e-4829-926e-1b9d0ca34734 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.148946 May 24 14:09:36.985002 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 464/931] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:36 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:38.001302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:38.001941 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:38.009000 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:38.009450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:38.010199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:38.010629 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:38.138901 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:38.146180 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cdc5c80f-68d1-404f-950c-f7187d333bd3 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.148747 May 24 14:09:38.146735 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 468/932] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:37 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:39.163240 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:39.164028 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:39.170644 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:39.171137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:39.171946 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:39.172390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:39.268690 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-50769411-3625-4598-b3ea-ab72d5ad3879 req-2d78792c-239e-46bd-b329-92ce0dff4146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eb3d32-4276-4fa6-bc39-db388390a284", "name": "network-vif-plugged", "status": "completed", "tag": "2ff53749-05a2-4474-b061-4cf3f20a2ba9"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:09:39.282293 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-50769411-3625-4598-b3ea-ab72d5ad3879 req-2d78792c-239e-46bd-b329-92ce0dff4146 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:39.282944 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-50769411-3625-4598-b3ea-ab72d5ad3879 req-2d78792c-239e-46bd-b329-92ce0dff4146 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:39.297296 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-50769411-3625-4598-b3ea-ab72d5ad3879 req-2d78792c-239e-46bd-b329-92ce0dff4146 service nova] Creating event network-vif-plugged:2ff53749-05a2-4474-b061-4cf3f20a2ba9 for instance 29eb3d32-4276-4fa6-bc39-db388390a284 on hv-cinder-84212 May 24 14:09:39.303423 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-50769411-3625-4598-b3ea-ab72d5ad3879 req-2d78792c-239e-46bd-b329-92ce0dff4146 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039249 May 24 14:09:39.305355 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 469/933] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 14:09:39.312713 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:39.321327 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1091076e-99e1-44c8-99af-a3f944544910 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.162039 May 24 14:09:39.322174 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 465/934] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:39 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:40.339390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:40.340121 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:40.346860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:40.347313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:40.348112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:40.348552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:40.478761 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:40.486027 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9821d2bc-c021-4306-98ff-707efba33611 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1318 microversion: 2.1 time: 0.151293 May 24 14:09:40.486588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 470/935] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:40 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:41.503358 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:41.503925 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:41.506335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:41.512906 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:41.513347 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:41.514112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:41.514540 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:41.642129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:09:41.649841 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6a946957-e7f9-4541-b798-8bb6b0667a0a tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1505 microversion: 2.1 time: 0.150715 May 24 14:09:41.650419 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 466/936] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:09:41 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:09:41.666015 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2acc4cdd-63d3-4ddd-b77d-30007b5691fe", "device": "/dev/sdb"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:09:41.667106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:41.669114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:41.669789 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:41.675927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:41.676374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:41.677137 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:41.677568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:41.913315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b21a62d5-f455-454b-9fdd-e275460a67f0 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "POST /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251143 May 24 14:09:41.913913 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 471/937] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:09:41 2022] POST /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:09:50.510850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:09:50.511368 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:50.517875 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:50.518321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:50.519078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:50.519510 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:50.542871 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b1186459-cfe2-4558-bad8-3ea21031dc0c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/ips" status: 200 len: 145 microversion: 2.1 time: 0.036876 May 24 14:09:50.543436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 467/938] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 14:09:50 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:09:55.894726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:55.895581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:09:55.901259 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5f10cd3-7bc9-42b8-ad8a-00226d90c7f5"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:09:55.902455 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:09:55.911354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:55.911992 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:55.912759 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:09:55.913191 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:09:58.993958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bfb0390b-7600-40b6-b5a2-de0c0a5bf259 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.100154 May 24 14:09:58.994576 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 472/939] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:09:55 2022] POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-volume_attachments => generated 194 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:10:03.314610 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:03.315105 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:03.317180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=16 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:03.317905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=30 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:03.323331 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:03.323776 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:03.324555 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:03.324987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:03.404735 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lazy-loading 'services' on Instance uuid 29eb3d32-4276-4fa6-bc39-db388390a284 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:10:03.475085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aa977a32-abe6-46a2-b316-c7020b51a370 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "DELETE /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284/os-volume_attachments/2acc4cdd-63d3-4ddd-b77d-30007b5691fe" status: 202 len: 0 microversion: 2.1 time: 0.164190 May 24 14:10:03.475667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 468/940] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:10:03 2022] DELETE /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284/os-volume_attachments/2acc4cdd-63d3-4ddd-b77d-30007b5691fe => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:10:06.498496 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a781a62b-6c6a-4cda-a0f3-dac9af19f165 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:06.501098 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:06.507650 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a781a62b-6c6a-4cda-a0f3-dac9af19f165 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:06.508504 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a781a62b-6c6a-4cda-a0f3-dac9af19f165 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:06.568078 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a781a62b-6c6a-4cda-a0f3-dac9af19f165 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Going to try to stop instance {{(pid=117494) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 14:10:06.612499 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a781a62b-6c6a-4cda-a0f3-dac9af19f165 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action" status: 202 len: 0 microversion: 2.1 time: 0.117941 May 24 14:10:06.613345 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 473/941] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:10:06 2022] POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:10:06.622936 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:06.623649 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:06.630625 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:06.630837 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:06.631626 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:06.632145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:06.773763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:06.782035 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-96bbb155-7544-4b6d-ac73-e94724b2eca0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.164290 May 24 14:10:06.782599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 469/942] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:06 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:07.753986 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:07.754604 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:07.762470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:07.762865 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:07.763634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:07.764129 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:07.788553 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:10:07.799480 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:07.800119 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:07.808309 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:07.809096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:07.810459 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:07.811179 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:07.876053 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9444fa5c-d667-493c-ba3a-4da0813d3bb5 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "DELETE /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 204 len: 0 microversion: 2.1 time: 0.125803 May 24 14:10:07.877146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 474/943] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:10:07 2022] DELETE /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:10:07.887420 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:07.888174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:07.894131 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:07.894726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:07.895344 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:07.895781 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:07.944134 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:07.952917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5e5b91e2-a507-44fb-8239-95fee6080f82 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.157220 May 24 14:10:07.953486 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 470/944] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:07 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:08.028510 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:08.035886 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2975208b-d8fc-458c-8e75-e3463d90d21f tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1511 microversion: 2.1 time: 0.154442 May 24 14:10:08.036481 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 475/945] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:07 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:08.969992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:08.970541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:08.976857 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:08.977818 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:08.978721 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:08.979154 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:09.053188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:09.053801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:09.061046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:09.061498 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:09.062268 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:09.062711 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:09.110454 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:09.119148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7f702902-e1f4-481b-8165-5ca7f5c5b95a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.152910 May 24 14:10:09.119734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 471/946] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:08 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:09.196862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:09.204438 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9b42586b-1a04-4138-86a3-2b7f709e4b36 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1511 microversion: 2.1 time: 0.155118 May 24 14:10:09.205001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 476/947] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:09 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:10.136783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:10.137416 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:10.145395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:10.145855 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:10.146643 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:10.147084 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:10.222388 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:10.223038 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:10.229850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:10.230307 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:10.231081 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:10.231521 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:10.361132 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:10.370385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1b902358-bd23-4732-80c3-d4aa1b5fe05b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.237385 May 24 14:10:10.371175 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 472/948] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:10 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:10.463010 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dd68e21b78f49b09a958415b17f6aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dfef898db944127a1407a9be98cac4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:10.470719 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-81170770-ba30-47e5-bffc-987762fbe465 tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 200 len: 1469 microversion: 2.1 time: 0.252156 May 24 14:10:10.471289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 477/949] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:10 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:10.501181 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-1c42e973-a21f-4f89-ab2a-27aa1f6a701f req-3ab61e51-d269-41e9-833b-3fe7ba86f4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29eb3d32-4276-4fa6-bc39-db388390a284", "name": "network-vif-deleted", "tag": "2ff53749-05a2-4474-b061-4cf3f20a2ba9"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:10.510219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1c42e973-a21f-4f89-ab2a-27aa1f6a701f req-3ab61e51-d269-41e9-833b-3fe7ba86f4a8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:10.510669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1c42e973-a21f-4f89-ab2a-27aa1f6a701f req-3ab61e51-d269-41e9-833b-3fe7ba86f4a8 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:10.522187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-1c42e973-a21f-4f89-ab2a-27aa1f6a701f req-3ab61e51-d269-41e9-833b-3fe7ba86f4a8 service nova] Creating event network-vif-deleted:2ff53749-05a2-4474-b061-4cf3f20a2ba9 for instance 29eb3d32-4276-4fa6-bc39-db388390a284 on hv-cinder-84212 May 24 14:10:10.527083 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-1c42e973-a21f-4f89-ab2a-27aa1f6a701f req-3ab61e51-d269-41e9-833b-3fe7ba86f4a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029925 May 24 14:10:10.527676 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 473/950] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:10:11.389065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:11.389674 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:11.396086 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:11.396543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:11.397299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:11.397732 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:11.489024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:11.489722 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] [instance: 29eb3d32-4276-4fa6-bc39-db388390a284] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:11.502969 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:11.503435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:11.504596 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:11.505034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:11.518958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] HTTP exception thrown: Instance 29eb3d32-4276-4fa6-bc39-db388390a284 could not be found. May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Request method failure captured: May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 HTTP/1.1 May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijObLCTLXc85tdQHhxGW4utojxsNesovpl9fCxsTJP2syM3JOzmJoe0D1ruNsGMLGXWiJEPQ7zqTnuP9n251jM4_iNRXOS6lD-9pk4SGlfQYVDeTzNKG4ySyQOdr6JNPFw3uAcs9rxEI_DUbXbryL6Hxsu9NFogYk--eGFTxWDNq0DUg May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 1dfef898db944127a1407a9be98cac4f May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2008450976 May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:10:11.520669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_1dfef898db944127a1407a9be98cac4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/1dfef898db944127a1407a9be98cac4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1dfef898db944127a1407a9be98cac4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/1dfef898db944127a1407a9be98cac4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesSnapshotTestJSON-2008450976 May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 1dfef898db944127a1407a9be98cac4f May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2008450976 May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesSnapshotTestJSON-2008450976-project May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 8dd68e21b78f49b09a958415b17f6aa8 May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesSnapshotTestJSON-2008450976-project May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 29eb3d32-4276-4fa6-bc39-db388390a284 could not be found. May 24 14:10:11.522268 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '29eb3d32-4276-4fa6-bc39-db388390a284'} May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29eb3d32-4276-4fa6-bc39-db388390a284 could not be found. May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:10:11.523143 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29eb3d32-4276-4fa6-bc39-db388390a284 could not be found. May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29eb3d32-4276-4fa6-bc39-db388390a284 could not be found. May 24 14:10:11.525266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:10:11.526599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] Returning 404 to user: Instance 29eb3d32-4276-4fa6-bc39-db388390a284 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:10:11.526599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0366072c-8c7c-4aa5-b254-ebf3dbf5f98b tempest-VolumesSnapshotTestJSON-2008450976 tempest-VolumesSnapshotTestJSON-2008450976-project] 10.222.0.24 "GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284" status: 404 len: 111 microversion: 2.1 time: 0.037230 May 24 14:10:11.526599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 474/951] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:11 2022] GET /compute/v2.1/servers/29eb3d32-4276-4fa6-bc39-db388390a284 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 14:10:11.541425 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:11.549787 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-820939fa-bb52-4353-a7c2-1fae388c4cfa tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.164572 May 24 14:10:11.550338 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 478/952] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:11 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:12.566748 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:12.567353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:12.574336 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:12.574781 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:12.575530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:12.575997 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:12.702805 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:12.710573 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eaeb4980-1768-4c14-9faf-d7b29577d95e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.147712 May 24 14:10:12.711128 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 475/953] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:12 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:13.727091 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:13.727928 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:13.734382 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:13.734829 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:13.735588 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:13.736054 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:13.862712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:13.871288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dd68ebb0-ff81-4924-8b56-a88309102109 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.148067 May 24 14:10:13.871867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 479/954] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:13 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:14.889488 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:14.890006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:14.896536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:14.896980 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:14.897751 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:14.898166 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:15.024536 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:15.032706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0bcd95fe-bd36-44e7-ab81-0bbaff49aeba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.147252 May 24 14:10:15.033279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 476/955] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:14 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:16.050871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:16.051497 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:16.058574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:16.059028 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:16.059800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:16.060267 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:16.187147 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:16.194973 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f7746546-8471-4ef7-88a5-c78fb0b9e1e0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.148080 May 24 14:10:16.195526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 480/956] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:16 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:17.213589 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:17.214199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:17.220539 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:17.220987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:17.221741 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:17.222170 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:17.354522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:17.362393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7d100cd6-ee88-4403-8cf0-74198a9a8e12 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.153625 May 24 14:10:17.362962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 477/957] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:17 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:18.385225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:18.385225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:18.389628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:18.390092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:18.390867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:18.391308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:18.541697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:18.549695 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-07ccf834-9bc4-4959-a4cd-685993b3deeb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.173347 May 24 14:10:18.550258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 481/958] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:18 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:19.567003 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:19.567608 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:19.574186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:19.574631 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:19.575386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:19.575830 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:19.717982 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:19.725971 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4a153143-3cbf-478c-938d-ff5e78855f62 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.162750 May 24 14:10:19.726534 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 478/959] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:19 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:20.744636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:20.745351 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:20.751779 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:20.752267 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:20.753036 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:20.753476 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:20.891972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:20.901204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9b261083-4952-4ce1-bcb1-b5780d2b0af0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.161081 May 24 14:10:20.911758 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 482/960] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:20 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:21.918794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:21.919316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:21.925883 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:21.926335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:21.927101 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:21.927547 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:22.027362 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:10:22.027586 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:10:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad (ip 10.222.0.24) !!! May 24 14:10:22.082468 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:22.091056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aa86a1b3-b932-418b-855a-1c3dcdb936ed tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1722 microversion: 2.1 time: 0.176206 May 24 14:10:22.091604 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 479/961] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:21 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:23.109229 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:23.109821 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:23.117859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:23.117859 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:23.118285 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:23.118450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:23.254244 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:23.263549 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c412988a-58f7-4354-b481-da7487695d85 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1699 microversion: 2.1 time: 0.158344 May 24 14:10:23.264246 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 483/962] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:23 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:23.280288 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe832d2a-7810-40ea-842d-1af0af2c4e02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:23.286262 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe832d2a-7810-40ea-842d-1af0af2c4e02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:23.286715 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe832d2a-7810-40ea-842d-1af0af2c4e02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:23.349449 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fe832d2a-7810-40ea-842d-1af0af2c4e02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Going to try to start instance {{(pid=117493) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 14:10:23.394232 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fe832d2a-7810-40ea-842d-1af0af2c4e02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action" status: 202 len: 0 microversion: 2.1 time: 0.117888 May 24 14:10:23.394717 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 480/963] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:10:23 2022] POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:10:23.403696 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:23.404445 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:23.411031 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:23.411798 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:23.412648 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:23.413093 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:23.431519 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:23.549889 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:23.558362 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-1bf15547-f0c9-4346-b5f5-8985f3fda6cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1708 microversion: 2.1 time: 0.159362 May 24 14:10:23.558929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 484/964] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:23 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:24.449640 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:24.450237 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:24.451628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-56840724-1e64-493b-a1b6-71df99c2de06 req-81c3170f-cd2c-4ae2-bf29-f59dcd09b62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:24.456744 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.457197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.457969 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.458410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.460643 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-56840724-1e64-493b-a1b6-71df99c2de06 req-81c3170f-cd2c-4ae2-bf29-f59dcd09b62f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.461332 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-56840724-1e64-493b-a1b6-71df99c2de06 req-81c3170f-cd2c-4ae2-bf29-f59dcd09b62f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.472890 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-56840724-1e64-493b-a1b6-71df99c2de06 req-81c3170f-cd2c-4ae2-bf29-f59dcd09b62f service nova] Creating event network-changed:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:10:24.478114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-56840724-1e64-493b-a1b6-71df99c2de06 req-81c3170f-cd2c-4ae2-bf29-f59dcd09b62f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030959 May 24 14:10:24.479315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 485/965] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:10:24.501435 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:10:24.575811 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:24.576896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:24.583312 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cfe90436-a09d-4151-b681-2c2238ea4923 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 204 len: 0 microversion: 2.1 time: 0.138657 May 24 14:10:24.583964 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.584208 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 481/966] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:10:24 2022] DELETE /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:10:24.584794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.585580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.586019 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.593157 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:24.593845 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:24.599996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.600581 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.601770 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:24.602318 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:24.622877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:24.729795 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:24.738386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d0d88b6b-dde6-4185-ba9b-b38a9176b26a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1708 microversion: 2.1 time: 0.167652 May 24 14:10:24.739158 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 486/967] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:24 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:24.744252 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:24.752241 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-64cb20d9-a229-4224-aa7c-ba3bbac1dec6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.163374 May 24 14:10:24.753022 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 482/968] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:24 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:25.756360 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:25.756972 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:25.764058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:25.764519 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:25.765903 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:25.766517 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:25.770995 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:25.771637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:25.778137 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:25.778587 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:25.779347 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:25.779780 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:25.897823 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:25.905976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-75eeb4b7-ebb8-4752-a9ec-3461fd2f8c78 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1708 microversion: 2.1 time: 0.153806 May 24 14:10:25.906546 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 487/969] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:25 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:25.912962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:25.920937 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b54a2c41-6f6a-4261-a051-997f98076b54 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.154003 May 24 14:10:25.921505 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 483/970] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:25 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:26.924092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:26.924813 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:26.931338 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:26.932403 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:26.933172 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:26.933914 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:26.938996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:26.939755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:26.946099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:26.946554 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:26.947580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:26.948055 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:27.073020 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:27.081046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-22ada371-9992-47df-96ac-415d46a4dd07 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1708 microversion: 2.1 time: 0.160885 May 24 14:10:27.081612 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 488/971] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:26 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:27.164282 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:27.172322 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-380176c1-e9e2-42a2-b5c8-7e8432422fb4 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1569 microversion: 2.1 time: 0.237169 May 24 14:10:27.172893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 484/972] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:26 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:28.062249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-658a2ae0-ce0c-4420-9626-5857b3abe640 req-dfffcfee-9102-46c9-8075-854a7d48a6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb63ce0-bd0a-4a00-ae22-d891b29fb857", "name": "network-vif-deleted", "tag": "0b05c79c-a61b-459e-a884-b9c7305f6581"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:28.072677 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-658a2ae0-ce0c-4420-9626-5857b3abe640 req-dfffcfee-9102-46c9-8075-854a7d48a6c1 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:28.073272 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-658a2ae0-ce0c-4420-9626-5857b3abe640 req-dfffcfee-9102-46c9-8075-854a7d48a6c1 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:28.084990 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-658a2ae0-ce0c-4420-9626-5857b3abe640 req-dfffcfee-9102-46c9-8075-854a7d48a6c1 service nova] Creating event network-vif-deleted:0b05c79c-a61b-459e-a884-b9c7305f6581 for instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 on hv-cinder-84212 May 24 14:10:28.093001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-658a2ae0-ce0c-4420-9626-5857b3abe640 req-dfffcfee-9102-46c9-8075-854a7d48a6c1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 May 24 14:10:28.093001 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 489/973] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:10:28.099735 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:28.100757 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:28.108647 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:28.109178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:28.110027 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:28.110530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:28.190228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:28.190991 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:28.197535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:28.197985 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:28.203974 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:28.204833 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:28.264382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:28.276481 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bae1ec5f-bfbd-4b1d-9d04-42aa3e6376d5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1708 microversion: 2.1 time: 0.181158 May 24 14:10:28.277394 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72aba3691e2e4b40b6643c8318caa9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe0605c62d04bed8edf14047746e765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:28.278046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 485/974] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:28 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1708 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:28.285792 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-54565a5b-eed7-4baf-8549-591c32576866 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 200 len: 1220 microversion: 2.1 time: 0.099421 May 24 14:10:28.287367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 490/975] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:28 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:10:29.294033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:29.294640 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:29.301018 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:29.301465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:29.302330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:29.302763 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:29.303198 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:29.303808 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [instance: 0fb63ce0-bd0a-4a00-ae22-d891b29fb857] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:29.310809 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:29.311374 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:29.312207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:29.312655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:29.327112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] HTTP exception thrown: Instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 could not be found. May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Request method failure captured: May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 HTTP/1.1 May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOXdggd4klQgMsJSmQKueG0Vm2Tvi0c19peMluKXt-i-RJClxCdM6LoxAbRWhJChS4Wy6QABM9NSM8MlK8cTUIqRUQ8fw2poVHQNTnj3vf89Xytr1k3QescxbIaRfDkf1u2fM8uaKIIigYMWqfXFPpaHFLb87jrnkD540BZVXDqA3jY May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: cbe0605c62d04bed8edf14047746e765 May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-TestShelveInstance-182891951 May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:10:29.328818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_cbe0605c62d04bed8edf14047746e765"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/cbe0605c62d04bed8edf14047746e765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/cbe0605c62d04bed8edf14047746e765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/cbe0605c62d04bed8edf14047746e765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-TestShelveInstance-182891951 May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: cbe0605c62d04bed8edf14047746e765 May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-TestShelveInstance-182891951 May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-TestShelveInstance-182891951-project May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 72aba3691e2e4b40b6643c8318caa9d6 May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-TestShelveInstance-182891951-project May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 could not be found. May 24 14:10:29.330433 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '0fb63ce0-bd0a-4a00-ae22-d891b29fb857'} May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 could not be found. May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:10:29.331308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 could not be found. May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 could not be found. May 24 14:10:29.332581 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:10:29.333810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Returning 404 to user: Instance 0fb63ce0-bd0a-4a00-ae22-d891b29fb857 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:10:29.333810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-38d9893e-534b-455f-bf3a-2d32177747a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857" status: 404 len: 111 microversion: 2.1 time: 0.030873 May 24 14:10:29.333810 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 491/976] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:29 2022] GET /compute/v2.1/servers/0fb63ce0-bd0a-4a00-ae22-d891b29fb857 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 14:10:29.434549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:29.442541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3ea01cf9-3329-4271-a7b0-69782dc6fb74 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1712 microversion: 2.1 time: 0.152436 May 24 14:10:29.443112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 486/977] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:29 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:29.502598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f95d7287-e7d9-43ec-9cae-9da1aca238a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] Calling method '.version_select at 0x7f33b569c040>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:29.507135 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f95d7287-e7d9-43ec-9cae-9da1aca238a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [dc5b205e-9fb5-4663-af11-1041e58da3de] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 14:10:30.515168 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [None req-f95d7287-e7d9-43ec-9cae-9da1aca238a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] [dc5b205e-9fb5-4663-af11-1041e58da3de] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 42216. May 24 14:10:30.534040 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f95d7287-e7d9-43ec-9cae-9da1aca238a6 tempest-TestShelveInstance-182891951 tempest-TestShelveInstance-182891951-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1993148995" status: 202 len: 0 microversion: 2.1 time: 1.035807 May 24 14:10:30.534622 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 492/978] 10.222.0.24 () {58 vars in 1253 bytes} [Tue May 24 14:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1993148995 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:10:53.302207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:10:53.303010 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:10:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:10:57.287651 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a6e52ee7-d033-450d-9654-a7b79696c80a tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Action: 'create', calling method: .version_select at 0x7f33b58f0af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-758967747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq/jM+1Ih94ZW8qeBmq1BQx67mQSRe11bCGb0BXdd1KrA5HRbHULsSZj7WTR4YpysU0dVsG7F9uPtE5YE4wFnByAw2C6ajIFNSNdsOxiwcs0fchbpQSBhbQHPRVPH+/hw=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:57.292148 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:57.293038 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=26 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:57.306542 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a6e52ee7-d033-450d-9654-a7b79696c80a tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Getting quotas for project b878ba5622b445a0be6f66811572d4cd. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:10:57.310283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a6e52ee7-d033-450d-9654-a7b79696c80a tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Getting quotas for user a21f7d97b64242cfa8bebe82b728c8bd and project b878ba5622b445a0be6f66811572d4cd. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:10:57.335460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a6e52ee7-d033-450d-9654-a7b79696c80a tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051671 May 24 14:10:57.336083 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 487/979] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:10:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:10:57.385286 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=32 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:57.385987 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:10:57.389933 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-84552040", "imageRef": "da4ac1b1-b6d0-4e86-9196-177e4cdb0e9c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-758967747", "networks": [{"uuid": "ca7ebee3-d4f2-4e52-bae6-d78f4c39715f"}]}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:10:57.582888 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.network.neutron [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] validate_networks() for [('ca7ebee3-d4f2-4e52-bae6-d78f4c39715f', None, None, None, None, None)] {{(pid=117494) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:10:57.954347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Flavor limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:10:57.954776 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Image limits 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:10:57.955249 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Flavor pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:10:57.955659 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Image pref 0:0:0 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:10:57.956100 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.virt.hardware [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:10:57.965628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:57.966077 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:57.966873 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:57.967309 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:57.984091 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Getting quotas for project b878ba5622b445a0be6f66811572d4cd. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:10:57.988011 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Getting quotas for user a21f7d97b64242cfa8bebe82b728c8bd and project b878ba5622b445a0be6f66811572d4cd. Resources: {'ram', 'cores', 'instances'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:10:57.999276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Going to run 1 instances... {{(pid=117494) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:10:58.001448 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='da4ac1b1-b6d0-4e86-9196-177e4cdb0e9c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:10:58.045436 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c212b7b5-2722-4279-b884-814329ca61a4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661831 May 24 14:10:58.046069 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 493/980] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:10:58.056641 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-77dd9302-0e97-4943-b5fa-14636b9473e4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:58.057375 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-77dd9302-0e97-4943-b5fa-14636b9473e4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:58.217655 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-77dd9302-0e97-4943-b5fa-14636b9473e4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:58.224553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-77dd9302-0e97-4943-b5fa-14636b9473e4 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1256 microversion: 2.1 time: 0.172492 May 24 14:10:58.225133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 488/981] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:58 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1256 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:10:59.242434 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:10:59.243275 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:10:59.250470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:59.251261 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:59.252181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:10:59.252738 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:10:59.347494 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:10:59.355297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-95d35b92-a312-4a85-a340-587c1fd9b877 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1314 microversion: 2.1 time: 0.117526 May 24 14:10:59.356286 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 494/982] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:10:59 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1314 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:00.372958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:00.373576 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:00.383379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:00.384243 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:00.385243 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:00.389003 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:00.521248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:00.530271 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8c0654a7-64d7-4059-87b0-d8e03e84eca2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.161159 May 24 14:11:00.530916 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 489/983] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:00 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:01.558022 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:01.559341 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:01.568188 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:01.569092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:01.570112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:01.570805 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:01.725697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:01.735212 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5d03c52c-0d27-4d2c-8d28-50a29c2be3d3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.191616 May 24 14:11:01.736024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 495/984] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:01 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:02.752287 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:02.752899 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:02.759884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:02.760289 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:02.761057 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:02.761503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:02.897008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:02.905830 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a9aee1d7-c1e9-4fb5-b99c-9c4dd898aebe tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.157292 May 24 14:11:02.914917 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 490/985] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:02 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:03.924294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:03.924892 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:03.931657 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:03.932192 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:03.932970 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:03.933655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:04.082231 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:04.090285 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-70511cdb-4a5c-44c1-834d-d525ded7a387 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.170528 May 24 14:11:04.090850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 496/986] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:03 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:05.106991 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:05.107574 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:05.113992 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:05.114432 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:05.115213 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:05.115642 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:05.270161 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:05.278441 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7b8f9b54-9ff4-474a-9212-4afb8fe414b8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.175844 May 24 14:11:05.279019 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 491/987] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:05 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:06.294792 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:06.295539 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:06.302200 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:06.302656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:06.303430 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:06.303910 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:06.441161 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:06.449562 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5e6828fb-c2c8-4b72-853f-0943dbeca0a3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.158745 May 24 14:11:06.450139 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 497/988] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:06 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:07.466985 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:07.467579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:07.474133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:07.474575 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:07.475335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:07.475759 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:07.604479 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:07.612954 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9cf581dc-929d-40d1-bada-639bf55d70d8 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.150405 May 24 14:11:07.624179 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 492/989] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:07 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:08.631292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:08.632005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:08.634457 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:08.635116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:08.641148 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:08.641594 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:08.642358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:08.642794 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:08.790291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:08.798621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2082dbfd-ac08-466b-b64d-b1f6baec7d30 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.171516 May 24 14:11:08.799419 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 498/990] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:08 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:09.814440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:09.815047 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:09.816908 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:09.822887 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:09.823330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:09.824110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:09.824545 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:09.955317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:09.963248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e0896383-e875-44c5-88f6-9d051001ccbf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.152141 May 24 14:11:09.963853 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 493/991] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:09 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:10.980173 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:10.980724 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:10.987145 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:10.987587 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:10.988369 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:10.988799 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:11.127654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:11.135580 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4306f399-2ca3-4e04-a457-69f88a5e8352 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.159590 May 24 14:11:11.136172 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 499/992] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:10 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:12.152925 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:12.153549 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:12.160357 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:12.160803 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:12.161582 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:12.162023 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:12.294452 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:12.302094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2443864d-0534-4a70-9b72-790514012da0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.153594 May 24 14:11:12.302665 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 494/993] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:12 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:12.825182 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-44bb49b2-181a-4f75-baf7-b533ca8be0ae req-097c67b9-5ea7-4520-a74f-d8f54780b9cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:12.838912 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-44bb49b2-181a-4f75-baf7-b533ca8be0ae req-097c67b9-5ea7-4520-a74f-d8f54780b9cf service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:12.839838 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-44bb49b2-181a-4f75-baf7-b533ca8be0ae req-097c67b9-5ea7-4520-a74f-d8f54780b9cf service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:12.854074 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-44bb49b2-181a-4f75-baf7-b533ca8be0ae req-097c67b9-5ea7-4520-a74f-d8f54780b9cf service nova] Creating event network-changed:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:11:12.859245 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-44bb49b2-181a-4f75-baf7-b533ca8be0ae req-097c67b9-5ea7-4520-a74f-d8f54780b9cf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040267 May 24 14:11:12.860347 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 500/994] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:11:13.319680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:13.320260 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:13.327168 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:13.327620 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:13.328422 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:13.328863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:13.459941 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:13.467910 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1a1618ec-c5ae-4f51-b8a9-7b508a7eb0f1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.152160 May 24 14:11:13.468478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 495/995] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:13 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:14.485636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:14.486274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:14.492490 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:14.492950 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:14.493856 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:14.494439 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:14.622058 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:14.629412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dd49b1b2-800d-428c-96c7-31efff6627fa tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.148632 May 24 14:11:14.630237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 501/996] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:14 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:15.646338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:15.646901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:15.655136 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:15.655960 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:15.657264 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:15.657719 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:15.790247 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:15.798982 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4b5b3bc1-cbeb-43fc-a746-6912c20e36d1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.156429 May 24 14:11:15.799922 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 496/997] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:15 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:16.816768 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:16.817317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:16.824420 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:16.824867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:16.825628 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:16.826063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:16.961478 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:16.969196 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bddf024a-eb23-4873-855e-8fd6acccf9f6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.156402 May 24 14:11:16.969764 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 502/998] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:16 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:17.903370 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-38f5f390-72cf-4fbc-8922-634390709e22 req-579b09eb-e8b7-4df5-b156-cf2f77ecf85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "name": "network-vif-plugged", "status": "completed", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:17.912095 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-38f5f390-72cf-4fbc-8922-634390709e22 req-579b09eb-e8b7-4df5-b156-cf2f77ecf85f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:17.912533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-38f5f390-72cf-4fbc-8922-634390709e22 req-579b09eb-e8b7-4df5-b156-cf2f77ecf85f service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:17.924178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-38f5f390-72cf-4fbc-8922-634390709e22 req-579b09eb-e8b7-4df5-b156-cf2f77ecf85f service nova] Creating event network-vif-plugged:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:11:17.929091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-38f5f390-72cf-4fbc-8922-634390709e22 req-579b09eb-e8b7-4df5-b156-cf2f77ecf85f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030119 May 24 14:11:17.929689 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 497/999] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:11:17.985822 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:17.986514 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:17.994386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:17.994935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:17.995770 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:17.996289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:18.187936 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:18.195274 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-72150073-76b2-4598-aca5-df356f0957ab tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.213389 May 24 14:11:18.195869 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 503/1000] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:17 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:19.213793 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:19.214497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:19.220958 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:19.221404 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:19.222169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:19.222605 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:19.354316 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:19.361838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3d9dcb5d-ed00-4442-b6ac-1b843037b7d6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1356 microversion: 2.1 time: 0.153165 May 24 14:11:19.362450 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 498/1001] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:19 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:20.379363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:20.380534 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:20.387762 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.388465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.389252 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.389683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.520207 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:20.528587 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c810fd76-ce50-4d2e-b91b-7493c868cae0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1544 microversion: 2.1 time: 0.153159 May 24 14:11:20.529166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 504/1002] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:20 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1544 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:20.545023 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:20.545652 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:20.552085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.552533 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.553291 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.553726 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.682738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:20.690452 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ec1b6bf8-c3a1-495b-824a-779d4a8241e5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1544 microversion: 2.1 time: 0.149997 May 24 14:11:20.691024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 499/1003] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:20 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1544 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:20.705867 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:20.709297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:20.710067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Searching by: {'deleted': False, 'project_id': 'b878ba5622b445a0be6f66811572d4cd'} {{(pid=117494) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 24 14:11:20.717211 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.717598 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.718383 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.718814 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.808197 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.multi_cell_list [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117494) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 24 14:11:20.898568 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dc19ddd7-9916-4926-af87-3c953e57ea5c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.196414 May 24 14:11:20.899155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 505/1004] 10.222.0.24 () {58 vars in 1124 bytes} [Tue May 24 14:11:20 2022] GET /compute/v2.1/servers => generated 341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:11:20.909170 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:20.909779 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:20.916178 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.916773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:20.917559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:20.917994 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:21.043623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:21.055483 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a219962e-8de6-46d8-9ebb-b841f7aff664 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1544 microversion: 2.1 time: 0.150052 May 24 14:11:21.056618 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 500/1005] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:20 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:22.557043 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12080202-1d92-4a8f-800f-157febc9cdbd"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:22.558223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:22.564661 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:22.565106 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:22.565860 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:22.566290 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:22.799299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-182e4762-63f4-4831-86cd-6e3e9264e073 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246980 May 24 14:11:22.800111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 506/1006] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:11:22 2022] POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:11:30.337913 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:30.338528 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:30.340978 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:30.347195 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:30.347645 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:30.348440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:30.348876 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:30.351984 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=69 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:30.485360 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:30.493248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fa136385-8742-46c7-b154-24bf0be88e18 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1590 microversion: 2.1 time: 0.159147 May 24 14:11:30.493827 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 501/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:30 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1590 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:32.158280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:32.162769 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-e5974bfc-47b5-46cb-acf1-009959a2533f req-31ed9502-8fb0-4c13-b332-a693b898d11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:32.167714 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:32.173171 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-e5974bfc-47b5-46cb-acf1-009959a2533f req-31ed9502-8fb0-4c13-b332-a693b898d11b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:32.173619 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-e5974bfc-47b5-46cb-acf1-009959a2533f req-31ed9502-8fb0-4c13-b332-a693b898d11b service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:32.178099 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:11:32.188316 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-e5974bfc-47b5-46cb-acf1-009959a2533f req-31ed9502-8fb0-4c13-b332-a693b898d11b service nova] Creating event network-changed:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:11:32.194701 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-e5974bfc-47b5-46cb-acf1-009959a2533f req-31ed9502-8fb0-4c13-b332-a693b898d11b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037976 May 24 14:11:32.195312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 507/1008] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:11:33.251008 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1749158197"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:33.252227 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:33.259270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:33.259714 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:33.261138 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:33.261630 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:33.391681 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.network.security_group_api [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Adding security group cf44fb62-4da8-41d8-95e7-4e3870b1512b to port 3c3792a2-16be-4b1a-9ed7-d4d04705b095 May 24 14:11:33.766825 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aaee473c-1ade-458c-af97-6b7443e01edf tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/action" status: 202 len: 0 microversion: 2.1 time: 0.519697 May 24 14:11:33.770886 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 502/1009] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:11:33 2022] POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 14:11:33.776260 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:33.782829 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:33.783411 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-0cdc691d-9559-4456-8cc6-81e3f88576b0 req-f07c8b98-a56c-4bc7-8307-42b5be1eb2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:33.792116 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:33.792935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:33.793367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:33.793996 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:33.810059 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-0cdc691d-9559-4456-8cc6-81e3f88576b0 req-f07c8b98-a56c-4bc7-8307-42b5be1eb2b2 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:33.810826 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-0cdc691d-9559-4456-8cc6-81e3f88576b0 req-f07c8b98-a56c-4bc7-8307-42b5be1eb2b2 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:33.830938 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-0cdc691d-9559-4456-8cc6-81e3f88576b0 req-f07c8b98-a56c-4bc7-8307-42b5be1eb2b2 service nova] Creating event network-changed:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:11:33.837443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-0cdc691d-9559-4456-8cc6-81e3f88576b0 req-f07c8b98-a56c-4bc7-8307-42b5be1eb2b2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057785 May 24 14:11:33.839656 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 503/1010] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:11:34.077819 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:34.085923 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-2d99fbe0-d53e-43ff-b27c-3988d6a061e2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1756 microversion: 2.1 time: 0.313863 May 24 14:11:34.087019 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 508/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:33 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1756 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:39.740736 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:39.741338 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:39.748563 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:39.749015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:39.749782 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:39.750229 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:39.830754 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lazy-loading 'services' on Instance uuid a98d1fc5-59b2-4360-ab1b-8154005f26ad {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:11:39.900335 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d54fabda-1e89-4eec-960e-f0937125e211 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-volume_attachments/e5f10cd3-7bc9-42b8-ad8a-00226d90c7f5" status: 202 len: 0 microversion: 2.1 time: 0.164499 May 24 14:11:39.900951 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 504/1012] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:11:39 2022] DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-volume_attachments/e5f10cd3-7bc9-42b8-ad8a-00226d90c7f5 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:11:41.014315 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-201aa47c-4474-45c0-8a20-6f129753c94f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:11:41.020832 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-201aa47c-4474-45c0-8a20-6f129753c94f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:41.021280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-201aa47c-4474-45c0-8a20-6f129753c94f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:41.042824 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-201aa47c-4474-45c0-8a20-6f129753c94f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Going to try to stop instance {{(pid=117494) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 14:11:41.083480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-201aa47c-4474-45c0-8a20-6f129753c94f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action" status: 202 len: 0 microversion: 2.1 time: 0.072985 May 24 14:11:41.084114 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 509/1013] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:11:41 2022] POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:11:41.094263 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:41.094979 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:41.101317 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:41.101772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:41.102553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:41.103180 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:41.240164 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:41.248308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8175a684-e85c-4807-a213-16207900ace0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.159740 May 24 14:11:41.248880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 505/1014] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:41 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:42.266236 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:42.266939 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:42.274173 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:42.274704 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:42.275515 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:42.276234 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:42.413875 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:42.422014 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-86d74240-65ff-46c7-96e2-4f15f6a3120c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.160085 May 24 14:11:42.422579 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 510/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:42 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:43.439214 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:43.439761 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:43.446315 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:43.446772 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:43.447566 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:43.448080 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:43.580046 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:43.587531 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6d311b82-71d3-40d2-9f8b-7e333210e4f6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.152355 May 24 14:11:43.588125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 506/1016] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:43 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:44.604509 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:44.605554 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:44.612050 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:44.612527 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:44.613281 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:44.613712 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:44.955228 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:44.962713 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-41d4bdda-101c-4e74-83d1-68b457fa8796 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.362012 May 24 14:11:44.963292 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 511/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:44 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:45.982003 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:45.982559 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:45.988987 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:45.989428 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:45.990186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:45.990614 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:46.116346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:46.124427 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-143a0053-20d3-46a5-ad73-eb7894be2abb tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.147161 May 24 14:11:46.124989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 507/1018] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:45 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:47.142146 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:47.142754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:47.149187 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:47.149634 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:47.150390 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:47.150826 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:47.275291 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:47.283263 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-82e1802a-566a-4f60-89bd-64d28b108c67 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.145004 May 24 14:11:47.283843 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 512/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:47 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:48.300828 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:48.301439 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:48.308892 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:48.309350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:48.310121 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:48.310560 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:48.450569 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:48.458033 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-732425a1-12da-48be-b6ee-02aa89c43d5a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.161086 May 24 14:11:48.458609 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 508/1020] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:48 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:49.474389 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:49.475005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:49.481684 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:49.482134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:49.482893 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:49.483330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:49.613747 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:49.621288 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6d738a6c-9fdd-4f27-8370-b39e9b0033b3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.150768 May 24 14:11:49.621855 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 513/1021] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:49 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:50.638607 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:50.639211 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:50.645656 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:50.646100 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:50.646850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:50.647281 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:50.774351 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:50.781834 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e4413f85-696b-47ce-a0d8-367978468537 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.147462 May 24 14:11:50.782396 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 509/1022] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:50 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:51.801353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:51.802083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:51.808842 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:51.809287 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:51.810046 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:51.810475 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:51.940398 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:51.947766 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9ca77f9a-1eb7-4995-a723-cec4e68c6dac tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.150556 May 24 14:11:51.948882 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 514/1023] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:51 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:52.965306 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:52.965846 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:52.972060 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:52.972511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:52.973270 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:52.973706 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:53.100996 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:53.108653 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0a090b93-d5e0-449a-8b24-a75031f47a2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.147349 May 24 14:11:53.109234 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 510/1024] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:52 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:54.125868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:54.126412 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:54.133134 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:54.133582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:54.134340 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:54.134773 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:54.260302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:54.268495 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-53d62927-9685-4287-85ee-2440412e5214 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.146660 May 24 14:11:54.269069 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 515/1025] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:54 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:55.286623 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:55.287223 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:55.294599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:55.295049 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:55.295848 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:55.296289 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:55.438186 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:55.445680 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a1d249c-8655-493e-8f36-b533c3211fb3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.163013 May 24 14:11:55.446241 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 511/1026] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:55 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:11:56.462578 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:56.463110 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:56.470477 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:56.470929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:56.471682 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:56.472136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:56.603971 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:56.611836 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-dab5b56b-5999-4412-87ba-4fdd709a9b2d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.153255 May 24 14:11:56.612408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 516/1027] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:56 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:57.629489 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:57.630099 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:57.636843 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:57.637309 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:57.638056 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:57.638493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:57.774523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:57.782527 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1e6fdc9e-16c6-42e3-b68c-df3921a7afef tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.156943 May 24 14:11:57.783092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 512/1028] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:57 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:58.798932 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:58.799451 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:58.806014 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:58.806473 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:58.807237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:58.808313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:58.933318 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:11:58.940777 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bd23064e-3e8f-4602-b863-0888decf5ca1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.145866 May 24 14:11:58.941353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 517/1029] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:58 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:11:59.957837 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:11:59.958386 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:11:59.965345 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:59.965794 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:11:59.966553 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:11:59.966986 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:00.093096 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:00.100509 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-42b396e9-fd4a-41ca-8c11-65bb78ac2ecd tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.146663 May 24 14:12:00.101081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 513/1030] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:11:59 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:01.117551 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:01.118181 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:01.125083 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:01.125537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:01.126303 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:01.126747 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:01.257077 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:01.265124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9d50445a-5458-451c-b457-acb15b5ecda5 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1676 microversion: 2.1 time: 0.151404 May 24 14:12:01.265697 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 518/1031] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:01 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:02.282497 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:02.283142 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:02.285632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=26 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:12:02.290888 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:02.291346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:02.292145 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:02.293179 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:02.297390 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:12:02.420887 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:02.428437 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ad180d45-d998-4a79-be62-1d2cbf0ae90d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1653 microversion: 2.1 time: 0.149872 May 24 14:12:02.429004 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 514/1032] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:02 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:02.444835 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4c38ef2b-d818-4e6f-9699-d76682fd5850 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:12:02.452124 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4c38ef2b-d818-4e6f-9699-d76682fd5850 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:02.452516 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4c38ef2b-d818-4e6f-9699-d76682fd5850 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:02.474620 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4c38ef2b-d818-4e6f-9699-d76682fd5850 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Going to try to start instance {{(pid=117494) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 14:12:02.517552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4c38ef2b-d818-4e6f-9699-d76682fd5850 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action" status: 202 len: 0 microversion: 2.1 time: 0.076418 May 24 14:12:02.518166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 519/1033] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:12:02 2022] POST /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:12:02.526346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:02.527561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:02.534266 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:02.534817 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:02.535709 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:02.536207 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:02.681834 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:02.689537 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-952ce6d5-8f39-4fba-9636-f0f625c96a60 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1662 microversion: 2.1 time: 0.167230 May 24 14:12:02.690110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 515/1034] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:02 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:03.708317 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:03.709039 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:03.716052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:03.716502 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:03.718047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:03.718652 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:03.854367 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:03.857503 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:12:03.864222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-fe36878d-6fee-4ae4-b820-15c148e7ba9c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1662 microversion: 2.1 time: 0.160675 May 24 14:12:03.864808 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 520/1035] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:03 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:04.880908 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:04.881437 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:04.888294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:04.888767 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:04.889523 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:04.889964 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:05.016869 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:05.024279 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f13645c5-66fe-451e-a306-19564b651c02 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1666 microversion: 2.1 time: 0.147546 May 24 14:12:05.024849 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 516/1036] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:04 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:34.861526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:12:34.862445 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:34.864531 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=27 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:12:34.871112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:34.871559 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:34.872354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:34.872790 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:34.944304 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-cd8e2043-2ad7-48d9-b808-f35bdf707c1b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/action" status: 202 len: 0 microversion: 2.1 time: 0.087006 May 24 14:12:34.944935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 521/1037] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:12:34 2022] POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 14:12:34.953839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:34.954503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:34.956561 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=5 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:12:34.957211 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=17 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:12:34.962899 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:34.963353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:34.964856 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:34.965323 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:35.123030 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:35.131319 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-13fb300b-3fd2-438e-a39c-6c0dcf30895c tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1748 microversion: 2.1 time: 0.181227 May 24 14:12:35.132217 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 517/1038] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:34 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1748 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:36.149842 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:36.150543 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:36.157358 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:36.157808 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:36.158572 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:36.159016 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:36.299005 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:36.306984 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f3a61119-b02f-40ed-8360-a4e0b50251b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.161968 May 24 14:12:36.307550 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 522/1039] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:36 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:37.324361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:37.324955 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:37.331360 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:37.331800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:37.332579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:37.333012 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:37.473579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:37.481839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aa376838-69d3-4d68-9d00-5df24b35f5c2 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.162158 May 24 14:12:37.482402 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 518/1040] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:37 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:12:38.498656 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:38.499290 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:38.506096 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:38.506544 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:38.507300 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:38.508170 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:38.644886 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:38.653450 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-bb30a718-d41d-4bbe-8d9f-68d6b9fc02b5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.158881 May 24 14:12:38.654018 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 523/1041] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:38 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:39.671346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:39.671985 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:39.678360 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:39.678799 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:39.679546 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:39.680006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:39.818409 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:39.826177 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ef33be3f-72f9-4d89-99f1-3bc0898acc48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.159663 May 24 14:12:39.826747 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 519/1042] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:39 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:40.843506 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:40.844169 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:40.850536 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:40.850986 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:40.851747 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:40.852206 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:40.992582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:41.001087 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-9c10d985-55c0-4d87-8cb8-bfa3e7ca1ed5 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.161505 May 24 14:12:41.001655 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 524/1043] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:40 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:42.019239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:42.019923 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:42.027110 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:42.027552 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:42.028334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:42.028768 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:42.171200 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:42.179149 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5e4fa5a9-7d44-469b-b84b-6d2490264dac tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.163871 May 24 14:12:42.179728 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 520/1044] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:42 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:43.197034 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:43.198166 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:43.204858 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:43.205298 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:43.206047 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:43.206480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:43.349104 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:43.357221 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-57ac1afb-aa44-49d8-94f2-b0e37dcbc780 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.164016 May 24 14:12:43.357807 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 525/1045] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:43 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:44.373267 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:44.373880 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:44.380294 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:44.380998 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:44.381757 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:44.382193 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:44.524883 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:44.533387 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-35c3a5ce-ba66-4469-b5e4-ff8e8271ea39 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.164115 May 24 14:12:44.533966 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 521/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:44 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:45.550237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:45.550850 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:45.558174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:45.558703 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:45.559468 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:45.563346 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:45.714258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:45.722308 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-69389205-c58b-4c58-89b2-2c54cb037de9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1753 microversion: 2.1 time: 0.175976 May 24 14:12:45.722882 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 526/1047] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:45 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:12:46.739235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:12:46.739852 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:12:46.746792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:46.747239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:46.748054 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:12:46.748492 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:12:46.891094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:12:46.899133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cc769d5b-2ffd-413b-bea9-653d1749e2b0 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1756 microversion: 2.1 time: 0.163805 May 24 14:12:46.899694 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 522/1048] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:12:46 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:09.535523 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:09.536596 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:09.538879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=12 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:09.539526 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:09.545611 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:09.546057 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:09.546849 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:09.547283 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:09.577788 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8c9fb647-b3a4-4854-849d-a14088d63cc9 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046088 May 24 14:13:09.578280 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 527/1049] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:13:09 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:13:09.637558 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:09.638050 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:09.640216 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=12 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:09.640965 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=36 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:09.646700 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:09.647151 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:09.647940 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:09.648378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:09.672637 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:13:09.745745 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ae21e6e3-a30c-4772-8dcc-cbe2004799de tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 204 len: 0 microversion: 2.1 time: 0.111948 May 24 14:13:09.746511 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 523/1050] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:13:09 2022] DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:13:09.754927 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:09.755544 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:09.762527 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:09.762980 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:09.763747 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:09.764212 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:09.892287 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:09.899691 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ebf60134-46fe-48a1-8c73-66817fa46cbc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1672 microversion: 2.1 time: 0.148750 May 24 14:13:09.900302 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 528/1051] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:09 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:10.917603 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:10.918225 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:10.924710 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:10.925166 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:10.925942 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:10.926382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:11.054314 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:11.062253 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-06508c97-06d8-4802-88fd-cee1bced7412 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1672 microversion: 2.1 time: 0.149110 May 24 14:13:11.062829 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 524/1052] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:10 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:12.020609 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-8da1d7d2-bb63-461f-8256-815eeea1a6d7 req-f3d0d629-c966-45d3-ba7f-68a277db0f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98d1fc5-59b2-4360-ab1b-8154005f26ad", "name": "network-vif-deleted", "tag": "4e64fdd4-c3e5-497b-9ca2-29d3b279c477"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:12.030699 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-8da1d7d2-bb63-461f-8256-815eeea1a6d7 req-f3d0d629-c966-45d3-ba7f-68a277db0f1c service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:12.031591 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-8da1d7d2-bb63-461f-8256-815eeea1a6d7 req-f3d0d629-c966-45d3-ba7f-68a277db0f1c service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:12.051097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-8da1d7d2-bb63-461f-8256-815eeea1a6d7 req-f3d0d629-c966-45d3-ba7f-68a277db0f1c service nova] Creating event network-vif-deleted:4e64fdd4-c3e5-497b-9ca2-29d3b279c477 for instance a98d1fc5-59b2-4360-ab1b-8154005f26ad on hv-cinder-84212 May 24 14:13:12.059042 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-8da1d7d2-bb63-461f-8256-815eeea1a6d7 req-f3d0d629-c966-45d3-ba7f-68a277db0f1c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112152 May 24 14:13:12.060306 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 529/1053] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:12.079094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:12.079936 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:12.087379 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:12.087839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:12.088624 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:12.090374 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:12.130091 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:12.130716 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:12.131734 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lazy-loading 'fault' on Instance uuid a98d1fc5-59b2-4360-ab1b-8154005f26ad {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:13:12.177632 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:12.185490 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3d14a58b-1c94-40f2-8231-f4ae76c0a314 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 200 len: 1327 microversion: 2.1 time: 0.110304 May 24 14:13:12.186081 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 525/1054] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:12 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:13.204002 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:13.204705 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:13.210868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:13.211318 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:13.212109 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:13.212552 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:13.226136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] HTTP exception thrown: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Request method failure captured: May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad HTTP/1.1 May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOaqIYDdRHB6M4fBFNIc7DavaokyOxblJRdWk9qngUAmAcs7c317OsTOY4NPoXdrApk3uMT5mGp8dj8kowXQ4UaP1J0DmCwXg9BW3b6Tl8X430_uxMR1unVI3ASt_RmzoX1KhcM_bfRkjneE0AqCsNLjBCS9sC4M-A4cssXCJH-I46k May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: e436feb329204699a78d749db135acce May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:13:13.227726 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e436feb329204699a78d749db135acce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e436feb329204699a78d749db135acce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeTestJSON-419866723 May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: e436feb329204699a78d749db135acce May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeTestJSON-419866723-project May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 54fce865bd6842c19583b3bfe607fc32 May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeTestJSON-419866723-project May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:13:13.229567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': 'a98d1fc5-59b2-4360-ab1b-8154005f26ad'} May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:13:13.230733 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:13:13.232525 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:13:13.234310 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Returning 404 to user: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:13:13.234310 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-22ddcc57-b4c7-467c-bdc6-5b3e7a38b894 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 404 len: 111 microversion: 2.1 time: 0.029924 May 24 14:13:13.234310 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 530/1055] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:13 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:13:13.237933 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-217b8a81-ca74-4567-99a6-890f7466e1b6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '.version_select at 0x7f33b5a05e50>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:13.255567 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-217b8a81-ca74-4567-99a6-890f7466e1b6 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-618084728" status: 202 len: 0 microversion: 2.1 time: 0.021351 May 24 14:13:13.256365 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 526/1056] 10.222.0.24 () {58 vars in 1217 bytes} [Tue May 24 14:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-618084728 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:13:14.144331 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e40784e7-5910-4844-908d-16e46dcfa91b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: .version_select at 0x7f33b5955a60>, body: {"keypair": {"name": "tempest-keypair-301748315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUOZ4Pds0tZReAmxTU0vQGfeuIRbNa1V4q350K98aMcnMd2+ahAF0KSOKxWHN/S7NriBkU/c/n2MYbK3bDdg5OGk6kEEtd8gvtZM/HzgrJ+j4aab6eb6jRtAhx8lPUuZg=="}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:14.158958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-e40784e7-5910-4844-908d-16e46dcfa91b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for project e436feb329204699a78d749db135acce. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:13:14.162685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.quota [None req-e40784e7-5910-4844-908d-16e46dcfa91b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for user 54fce865bd6842c19583b3bfe607fc32 and project e436feb329204699a78d749db135acce. Resources: {'key_pairs'} {{(pid=117494) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:13:14.184293 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e40784e7-5910-4844-908d-16e46dcfa91b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046143 May 24 14:13:14.184879 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 531/1057] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 24 14:13:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:15.420395 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2067735101", "imageRef": "f451f874-5cf0-452a-9232-bbdcde737ccc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0876f86-477e-43a6-b89a-5d925c2bd73a"}], "security_groups": [{"name": "tempest-securitygroup--1893358612"}], "key_name": "tempest-keypair-301748315", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:15.521815 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] validate_networks() for [('d0876f86-477e-43a6-b89a-5d925c2bd73a', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 14:13:15.922248 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 14:13:15.922935 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 14:13:15.923838 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 14:13:15.924476 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 14:13:15.924893 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 14:13:15.934554 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:15.934994 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:15.935846 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:15.936293 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:15.956032 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for project e436feb329204699a78d749db135acce. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 14:13:15.960113 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Getting quotas for user 54fce865bd6842c19583b3bfe607fc32 and project e436feb329204699a78d749db135acce. Resources: {'ram', 'cores', 'instances'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 14:13:15.971522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 14:13:15.973831 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f451f874-5cf0-452a-9232-bbdcde737ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 14:13:16.020517 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a67e40db-9379-411f-adac-c9964c17c2b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605851 May 24 14:13:16.021164 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 527/1058] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 24 14:13:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 14:13:16.031973 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6f530526-f216-40d2-ba42-7afb08e2a4f4 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:16.032590 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6f530526-f216-40d2-ba42-7afb08e2a4f4 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:16.089241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-6f530526-f216-40d2-ba42-7afb08e2a4f4 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:16.096065 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6f530526-f216-40d2-ba42-7afb08e2a4f4 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1237 microversion: 2.1 time: 0.068362 May 24 14:13:16.096636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 532/1059] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:16 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:17.113792 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:17.114579 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:17.122393 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:17.123662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:17.124901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:17.125381 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:17.191877 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:17.199375 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-27d7a146-aacd-4860-875b-62f913b271c1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1295 microversion: 2.1 time: 0.090648 May 24 14:13:17.199962 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 528/1060] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:17 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:18.217299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:18.217848 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:18.224527 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:18.224976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:18.225742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:18.226170 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:18.452474 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:18.460312 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-ab0f7229-8ba8-470f-ab7e-6c20b00afe94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.247699 May 24 14:13:18.460953 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 533/1061] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:18 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:18.646469 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-8dcf92fa-fa54-41e6-bf0e-5021546995e4 req-b7228169-8119-493e-85bc-f490049bd427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9954418b-cb4d-4071-878e-c2c7fb37d5d2", "tag": "7c859bac-238c-4f9a-90d0-1f20a8c84b95"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:18.673699 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-8dcf92fa-fa54-41e6-bf0e-5021546995e4 req-b7228169-8119-493e-85bc-f490049bd427 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:18.674340 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-8dcf92fa-fa54-41e6-bf0e-5021546995e4 req-b7228169-8119-493e-85bc-f490049bd427 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:18.688599 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-8dcf92fa-fa54-41e6-bf0e-5021546995e4 req-b7228169-8119-493e-85bc-f490049bd427 service nova] Creating event network-changed:7c859bac-238c-4f9a-90d0-1f20a8c84b95 for instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 on hv-cinder-84212 May 24 14:13:18.694491 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-8dcf92fa-fa54-41e6-bf0e-5021546995e4 req-b7228169-8119-493e-85bc-f490049bd427 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054449 May 24 14:13:18.695541 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 529/1062] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:19.478103 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:19.478639 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:19.484967 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:19.485408 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:19.486167 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:19.486597 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:19.620871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:19.628177 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-34463107-3926-4bda-962a-b71340ae8f46 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.154153 May 24 14:13:19.628744 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 534/1063] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:19 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:20.646028 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:20.646730 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:20.653478 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:20.653928 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:20.654686 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:20.655123 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:20.786329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:20.794627 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e7d397b3-3aa9-48b1-8655-b6af2daacd17 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.152834 May 24 14:13:20.795194 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 530/1064] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:20 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:21.812018 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:21.812624 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:21.819353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:21.819801 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:21.820574 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:21.821007 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:21.955636 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:21.962935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-f6f834e1-cbb2-4e3a-b85d-c0c6067cd8a0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.155622 May 24 14:13:21.963582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 535/1065] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:21 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:22.979804 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:22.980436 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:22.986644 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:22.987094 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:22.987887 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:22.988326 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:23.115508 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:23.123522 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c589a74d-0ea1-4a88-9be5-d4817e529127 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.147719 May 24 14:13:23.124149 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 531/1066] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:22 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:24.141059 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:24.141667 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:24.149982 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:24.150480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:24.151311 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:24.151862 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:24.278156 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:24.285470 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-c516bcaf-ff63-4ce2-a8ae-6d880675f124 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.148407 May 24 14:13:24.286038 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 536/1067] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:24 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 14:13:24.612402 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-5d16589d-793c-45fd-bb0a-6f7aadce05b6 req-b44eeb15-6199-4190-a5a3-0359b1b97b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9954418b-cb4d-4071-878e-c2c7fb37d5d2", "name": "network-vif-plugged", "status": "completed", "tag": "7c859bac-238c-4f9a-90d0-1f20a8c84b95"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:24.621219 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5d16589d-793c-45fd-bb0a-6f7aadce05b6 req-b44eeb15-6199-4190-a5a3-0359b1b97b33 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:24.621668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5d16589d-793c-45fd-bb0a-6f7aadce05b6 req-b44eeb15-6199-4190-a5a3-0359b1b97b33 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:24.632421 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-5d16589d-793c-45fd-bb0a-6f7aadce05b6 req-b44eeb15-6199-4190-a5a3-0359b1b97b33 service nova] Creating event network-vif-plugged:7c859bac-238c-4f9a-90d0-1f20a8c84b95 for instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 on hv-cinder-84212 May 24 14:13:24.637385 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-5d16589d-793c-45fd-bb0a-6f7aadce05b6 req-b44eeb15-6199-4190-a5a3-0359b1b97b33 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090220 May 24 14:13:24.637951 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 532/1068] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:25.302741 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:25.303353 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:25.310379 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:25.310828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:25.311589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:25.312052 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:25.440285 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:25.447615 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7137f0a7-a4ef-435c-bdab-124a67fc0544 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.148806 May 24 14:13:25.449074 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 537/1069] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:25 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:26.462805 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=2 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:26.464378 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell0:SELECT=6 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:26.469418 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:26.470115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:26.477681 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:26.478133 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:26.479013 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:26.479766 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:26.621678 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:26.629106 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a0e94ee8-33b9-4631-b9df-b42b7c044b35 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1363 microversion: 2.1 time: 0.167675 May 24 14:13:26.629670 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 533/1070] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:26 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:27.646487 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:27.647097 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:27.649127 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell0:SELECT=6 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:27.655289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:27.655738 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:27.656524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:27.656958 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:27.786823 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:27.794880 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-b95c24ed-84ca-4b9d-b453-51d23e9c0a41 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1548 microversion: 2.1 time: 0.152247 May 24 14:13:27.795445 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 538/1071] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:27 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:27.811123 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:27.811620 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:27.818460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:27.818905 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:27.819676 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:27.820141 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:27.897850 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-10c7c017-c5ed-4166-809f-3d4a63cf807c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090966 May 24 14:13:27.898503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 534/1072] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 24 14:13:27 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:28.873868 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-0ad607e0-6830-4662-946d-c7094acb348f req-38e02705-dc1f-4326-a010-88547b74cfca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9954418b-cb4d-4071-878e-c2c7fb37d5d2", "tag": "7c859bac-238c-4f9a-90d0-1f20a8c84b95"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:28.886589 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0ad607e0-6830-4662-946d-c7094acb348f req-38e02705-dc1f-4326-a010-88547b74cfca service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:28.887299 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-0ad607e0-6830-4662-946d-c7094acb348f req-38e02705-dc1f-4326-a010-88547b74cfca service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:28.898785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-0ad607e0-6830-4662-946d-c7094acb348f req-38e02705-dc1f-4326-a010-88547b74cfca service nova] Creating event network-changed:7c859bac-238c-4f9a-90d0-1f20a8c84b95 for instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 on hv-cinder-84212 May 24 14:13:28.904428 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-0ad607e0-6830-4662-946d-c7094acb348f req-38e02705-dc1f-4326-a010-88547b74cfca service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109239 May 24 14:13:28.905373 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 539/1073] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:50.515085 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:50.515843 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:50.520112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1749158197"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:50.520646 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:50.528424 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:50.528895 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:50.529668 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:50.530102 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:50.657849 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.network.security_group_api [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Removing security group cf44fb62-4da8-41d8-95e7-4e3870b1512b from port 3c3792a2-16be-4b1a-9ed7-d4d04705b095 May 24 14:13:51.026573 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-84d01194-21d7-4ae2-85c3-a28da3a3e6e6 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/action" status: 202 len: 0 microversion: 2.1 time: 0.512652 May 24 14:13:51.028635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 535/1074] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 24 14:13:50 2022] POST /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:13:51.032772 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:51.034167 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=54 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:13:51.040485 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-d367c076-57f3-4176-85b5-f192e7d13df6 req-115050ab-301d-45d0-9d70-564d56e705b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:51.057632 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-d367c076-57f3-4176-85b5-f192e7d13df6 req-115050ab-301d-45d0-9d70-564d56e705b1 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:51.058828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-d367c076-57f3-4176-85b5-f192e7d13df6 req-115050ab-301d-45d0-9d70-564d56e705b1 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:51.077480 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-d367c076-57f3-4176-85b5-f192e7d13df6 req-115050ab-301d-45d0-9d70-564d56e705b1 service nova] Creating event network-changed:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:13:51.083987 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-d367c076-57f3-4176-85b5-f192e7d13df6 req-115050ab-301d-45d0-9d70-564d56e705b1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053259 May 24 14:13:51.086294 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 540/1075] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:52.244014 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:52.244650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:52.251285 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:52.251806 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:52.252595 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:52.253024 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:52.335634 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lazy-loading 'services' on Instance uuid 50c210ef-d814-4516-bb61-d74a5a880aff {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:13:52.410950 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e3a9df72-06c9-4bdd-b483-f8832b9c0c2b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments/12080202-1d92-4a8f-800f-157febc9cdbd" status: 202 len: 0 microversion: 2.1 time: 0.171229 May 24 14:13:52.412047 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 536/1076] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:13:52 2022] DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments/12080202-1d92-4a8f-800f-157febc9cdbd => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:13:52.422128 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:52.423784 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:52.434465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:52.435141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:52.436637 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:52.437289 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:52.485462 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-d5878a23-a62a-48e4-944d-b5189705965b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068758 May 24 14:13:52.486055 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 541/1077] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:13:52 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:53.100656 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-1b91b65d-2413-4d1a-93a0-2bc2587576b8 req-010fbd00-6918-4ecf-9c42-63055194dc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:53.110115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1b91b65d-2413-4d1a-93a0-2bc2587576b8 req-010fbd00-6918-4ecf-9c42-63055194dc27 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:53.110727 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1b91b65d-2413-4d1a-93a0-2bc2587576b8 req-010fbd00-6918-4ecf-9c42-63055194dc27 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:53.122557 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-1b91b65d-2413-4d1a-93a0-2bc2587576b8 req-010fbd00-6918-4ecf-9c42-63055194dc27 service nova] Creating event network-changed:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:13:53.127526 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-1b91b65d-2413-4d1a-93a0-2bc2587576b8 req-010fbd00-6918-4ecf-9c42-63055194dc27 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030931 May 24 14:13:53.128187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 537/1078] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:53.500827 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:53.501935 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:53.508535 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:53.508976 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:53.509738 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:53.510170 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:53.538752 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6a600b28-264a-465c-8729-e1fff2bee686 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043514 May 24 14:13:53.539524 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 542/1079] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:13:53 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 14:13:53.550551 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:53.551125 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:53.557800 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:53.558811 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:53.559582 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:53.560031 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:53.637493 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] HTTP exception thrown: Instance 50c210ef-d814-4516-bb61-d74a5a880aff is not attached to volume 12080202-1d92-4a8f-800f-157febc9cdbd May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Request method failure captured: May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments/12080202-1d92-4a8f-800f-157febc9cdbd HTTP/1.1 May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOdiF7VcTi_A870sd43Hlo2NuvL2W0wKGNNPxklZzh5HVG05_DCUppHicec8PegFPk0_Y6mbUyUa-IDm1NEgn0Dhf52WqRzZOq8KDzcBjXfe2jTBdoVDzHQcBpct_W4foBPhHf6UInNLnU_Ei-KyTgMDkChyno_3MtJmb_ZOtymoG6w May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: b878ba5622b445a0be6f66811572d4cd May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestMinimumBasicScenario-946487326 May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:13:53.639929 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestMinimumBasicScenario-946487326 May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: b878ba5622b445a0be6f66811572d4cd May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-946487326 May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestMinimumBasicScenario-946487326-project May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: a21f7d97b64242cfa8bebe82b728c8bd May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestMinimumBasicScenario-946487326-project May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:13:53.641743 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 50c210ef-d814-4516-bb61-d74a5a880aff is not attached to volume 12080202-1d92-4a8f-800f-157febc9cdbd May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': '50c210ef-d814-4516-bb61-d74a5a880aff', 'id': '12080202-1d92-4a8f-800f-157febc9cdbd'} May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 12080202-1d92-4a8f-800f-157febc9cdbd. May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:13:53.642648 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c210ef-d814-4516-bb61-d74a5a880aff is not attached to volume 12080202-1d92-4a8f-800f-157febc9cdbd May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c210ef-d814-4516-bb61-d74a5a880aff is not attached to volume 12080202-1d92-4a8f-800f-157febc9cdbd May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:53.644218 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Returning 404 to user: Instance 50c210ef-d814-4516-bb61-d74a5a880aff is not attached to volume 12080202-1d92-4a8f-800f-157febc9cdbd {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:13:53.645454 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cf503d37-ca15-4dec-8718-f67c45480329 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments/12080202-1d92-4a8f-800f-157febc9cdbd" status: 404 len: 154 microversion: 2.1 time: 0.095114 May 24 14:13:53.645454 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 538/1080] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:13:53 2022] DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff/os-volume_attachments/12080202-1d92-4a8f-800f-157febc9cdbd => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:13:54.776067 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:54.776583 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:54.783237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:54.783678 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:54.784468 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:54.784899 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:54.809350 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Going to try to terminate instance {{(pid=117494) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:13:54.888785 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-6374ff55-6c11-4051-99a8-3053142a4e48 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 204 len: 0 microversion: 2.1 time: 0.116313 May 24 14:13:54.889363 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 543/1081] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:13:54 2022] DELETE /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:13:54.897766 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:54.898384 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:54.904954 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:54.905415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:54.906173 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:54.906612 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:55.032431 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:55.039773 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-011d3780-c3bb-478f-9416-376eb88c039b tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1550 microversion: 2.1 time: 0.146074 May 24 14:13:55.040361 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 539/1082] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:54 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:56.057586 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:56.058276 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:56.065757 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:56.066204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:56.066954 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:56.067386 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:56.199435 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:56.207537 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-80b5bcb0-6ac2-49de-8e89-0ee0429323b9 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1550 microversion: 2.1 time: 0.154216 May 24 14:13:56.208126 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 544/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:56 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:57.224382 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:57.225006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:57.231530 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:57.232015 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:57.232791 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:57.233235 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:57.365868 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f7d97b64242cfa8bebe82b728c8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b878ba5622b445a0be6f66811572d4cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:13:57.374197 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cd916f6c-af33-4e49-8d58-3bcdf427e1c3 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 200 len: 1550 microversion: 2.1 time: 0.153680 May 24 14:13:57.374981 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 540/1084] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:57 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:13:57.474443 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [req-ca6cb857-e038-4c20-81b4-a3df51259147 req-771e30e3-e75c-4d4d-92c8-d8eeea4388da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c210ef-d814-4516-bb61-d74a5a880aff", "name": "network-vif-deleted", "tag": "3c3792a2-16be-4b1a-9ed7-d4d04705b095"}]} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:13:57.485216 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-ca6cb857-e038-4c20-81b4-a3df51259147 req-771e30e3-e75c-4d4d-92c8-d8eeea4388da service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:57.485742 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [req-ca6cb857-e038-4c20-81b4-a3df51259147 req-771e30e3-e75c-4d4d-92c8-d8eeea4388da service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:57.497459 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.compute.server_external_events [req-ca6cb857-e038-4c20-81b4-a3df51259147 req-771e30e3-e75c-4d4d-92c8-d8eeea4388da service nova] Creating event network-vif-deleted:3c3792a2-16be-4b1a-9ed7-d4d04705b095 for instance 50c210ef-d814-4516-bb61-d74a5a880aff on hv-cinder-84212 May 24 14:13:57.502818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [req-ca6cb857-e038-4c20-81b4-a3df51259147 req-771e30e3-e75c-4d4d-92c8-d8eeea4388da service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032393 May 24 14:13:57.503679 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 545/1085] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:13:58.391543 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:58.392169 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] [instance: 50c210ef-d814-4516-bb61-d74a5a880aff] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:13:58.400304 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:58.401048 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:58.402346 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:13:58.403075 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:13:58.422863 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] HTTP exception thrown: Instance 50c210ef-d814-4516-bb61-d74a5a880aff could not be found. May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Request method failure captured: May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff HTTP/1.1 May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOdiF7VcTi_A870sd43Hlo2NuvL2W0wKGNNPxklZzh5HVG05_DCUppHicec8PegFPk0_Y6mbUyUa-IDm1NEgn0Dhf52WqRzZOq8KDzcBjXfe2jTBdoVDzHQcBpct_W4foBPhHf6UInNLnU_Ei-KyTgMDkChyno_3MtJmb_ZOtymoG6w May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: b878ba5622b445a0be6f66811572d4cd May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestMinimumBasicScenario-946487326 May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:13:58.424447 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/b878ba5622b445a0be6f66811572d4cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestMinimumBasicScenario-946487326 May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: b878ba5622b445a0be6f66811572d4cd May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-946487326 May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestMinimumBasicScenario-946487326-project May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: a21f7d97b64242cfa8bebe82b728c8bd May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestMinimumBasicScenario-946487326-project May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 50c210ef-d814-4516-bb61-d74a5a880aff could not be found. May 24 14:13:58.426065 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '50c210ef-d814-4516-bb61-d74a5a880aff'} May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c210ef-d814-4516-bb61-d74a5a880aff could not be found. May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:13:58.427067 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c210ef-d814-4516-bb61-d74a5a880aff could not be found. May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c210ef-d814-4516-bb61-d74a5a880aff could not be found. May 24 14:13:58.428667 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:13:58.430109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Returning 404 to user: Instance 50c210ef-d814-4516-bb61-d74a5a880aff could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:13:58.430109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0faa6c46-0c36-4422-918d-63a279553e2e tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff" status: 404 len: 111 microversion: 2.1 time: 0.038330 May 24 14:13:58.430109 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 541/1086] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:13:58 2022] GET /compute/v2.1/servers/50c210ef-d814-4516-bb61-d74a5a880aff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:13:58.438840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-7b939975-f012-46c0-9614-35c230b11ac1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] Calling method '.version_select at 0x7f33b5b2a430>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:13:58.456035 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-7b939975-f012-46c0-9614-35c230b11ac1 tempest-TestMinimumBasicScenario-946487326 tempest-TestMinimumBasicScenario-946487326-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-758967747" status: 202 len: 0 microversion: 2.1 time: 0.023861 May 24 14:13:58.456621 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 546/1087] 10.222.0.24 () {58 vars in 1268 bytes} [Tue May 24 14:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-758967747 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:13:59.580642 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:13:59.581330 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:13:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:14:43.963778 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:14:43.964369 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:14:43.967006 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_api:SELECT=14 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:14:43.967755 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG dbcounter [-] [117493] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=117493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:14:43.973205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:43.973650 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:43.974410 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:43.974846 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:43.998440 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d33a89e9-3080-40cb-9acf-8714883f4ca3 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/ips" status: 200 len: 145 microversion: 2.1 time: 0.038720 May 24 14:14:43.998989 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 542/1088] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 24 14:14:43 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:14:45.324223 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:14:45.325059 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG dbcounter [-] [117494] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117494) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 14:14:45.329606 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a4a3e25-59fe-4f7e-9656-a78538687b6c"}} {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:14:45.330878 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:14:45.338949 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:45.339569 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:45.341199 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:45.341677 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:45.603270 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-33a58d43-cfee-4e10-9463-1d5096a9ac5c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280236 May 24 14:14:45.604115 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 547/1089] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:14:45 2022] POST /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:14:53.105329 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:14:53.106535 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:14:53.112578 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:53.113032 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:53.113796 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:53.114242 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:53.143183 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f7d3a338-ff72-404c-8f8a-e8d51826dd04 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041972 May 24 14:14:53.143724 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 543/1090] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:14:53 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:14:53.155356 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:14:53.155968 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:14:53.162100 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:53.162539 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:53.163295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:53.163755 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:53.191297 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8e41f265-4004-47c0-8003-fdf8233e433b tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/3a4a3e25-59fe-4f7e-9656-a78538687b6c" status: 200 len: 194 microversion: 2.1 time: 0.041641 May 24 14:14:53.191872 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 548/1091] 10.222.0.24 () {58 vars in 1412 bytes} [Tue May 24 14:14:53 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/3a4a3e25-59fe-4f7e-9656-a78538687b6c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:14:54.510187 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caf30e0f-2c55-4340-816f-373dcdafaaa3"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:14:54.511276 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:14:54.518839 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:54.519283 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:54.520078 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:14:54.520515 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:14:54.761092 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4386f768-a145-48a1-a0ed-0e2b612ad771 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "POST /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255022 May 24 14:14:54.762292 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 544/1092] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 24 14:14:54 2022] POST /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:15:02.258818 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:02.260108 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:02.267090 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:02.267573 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:02.268399 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:02.268840 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:02.298528 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4f076be4-8d0f-40f7-aef5-7f2270d98c2f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043894 May 24 14:15:02.299089 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 549/1093] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:15:02 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:15:02.443199 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:02.443757 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:02.450671 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:02.451115 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:02.451902 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:02.452343 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:02.479688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-44954b48-349b-4231-96c2-a349e6ff4fc1 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/3a4a3e25-59fe-4f7e-9656-a78538687b6c" status: 200 len: 194 microversion: 2.1 time: 0.041383 May 24 14:15:02.480394 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 545/1094] 10.222.0.24 () {58 vars in 1412 bytes} [Tue May 24 14:15:02 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/3a4a3e25-59fe-4f7e-9656-a78538687b6c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:15:02.489858 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:02.490356 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:02.497030 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:02.497472 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:02.498241 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:02.498685 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:02.582063 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lazy-loading 'services' on Instance uuid 9954418b-cb4d-4071-878e-c2c7fb37d5d2 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:15:02.654384 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e4127ce5-8b31-43fe-b8f7-97a65863f676 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/3a4a3e25-59fe-4f7e-9656-a78538687b6c" status: 202 len: 0 microversion: 2.1 time: 0.167897 May 24 14:15:02.655314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 550/1095] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:15:02 2022] DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/3a4a3e25-59fe-4f7e-9656-a78538687b6c => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 14:15:03.779635 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:03.780209 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:03.786732 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:03.787181 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:03.787977 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:03.788504 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:03.817652 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bfad39b0-1de6-4932-834c-1230dcafc06f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/caf30e0f-2c55-4340-816f-373dcdafaaa3" status: 200 len: 194 microversion: 2.1 time: 0.042570 May 24 14:15:03.818239 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 546/1096] 10.222.0.24 () {58 vars in 1412 bytes} [Tue May 24 14:15:03 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/caf30e0f-2c55-4340-816f-373dcdafaaa3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:15:03.829558 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:03.830142 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:03.836413 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:03.836861 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:03.837651 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:03.838092 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:03.921467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.objects.instance [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lazy-loading 'services' on Instance uuid 9954418b-cb4d-4071-878e-c2c7fb37d5d2 {{(pid=117494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 14:15:03.992517 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-e38e57c5-4bcf-4421-aeb2-8c507e19532c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/caf30e0f-2c55-4340-816f-373dcdafaaa3" status: 202 len: 0 microversion: 2.1 time: 0.168169 May 24 14:15:03.993141 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 551/1097] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 24 14:15:03 2022] DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments/caf30e0f-2c55-4340-816f-373dcdafaaa3 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 14:15:05.156461 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:05.157397 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:05.163895 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.164350 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.165112 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.165555 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.194820 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1039050e-18ad-4c8a-a75b-08691f8494ba tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042907 May 24 14:15:05.195391 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 547/1098] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:15:05 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:15:05.300739 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:05.301856 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:05.309107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.309582 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.310352 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.310793 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.338979 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-8e1c1e1f-acf5-4dca-94f3-e50415a2362d tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042562 May 24 14:15:05.339567 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 552/1099] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 24 14:15:05 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 14:15:05.396040 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:05.396545 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:05.402750 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.403205 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.404005 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.404443 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.428171 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 14:15:05.502039 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e1f811bb-6fee-44f0-9e8b-a88fe85e47b7 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 204 len: 0 microversion: 2.1 time: 0.109507 May 24 14:15:05.502647 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 548/1100] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:15:05 2022] DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 14:15:05.518883 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:05.519492 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:05.525501 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.525945 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.526700 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:05.527401 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:05.655901 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:15:05.663665 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-a385da28-b508-424b-afbb-5e2abd16939c tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1673 microversion: 2.1 time: 0.155790 May 24 14:15:05.664258 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 553/1101] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:15:05 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:15:06.682470 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:06.683503 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:06.690012 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:06.690460 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:06.691228 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:06.691662 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:06.825170 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:15:06.832580 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c2e1f42a-68f9-42fd-b3e5-f647f38708cc tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1673 microversion: 2.1 time: 0.154430 May 24 14:15:06.833144 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 549/1102] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:15:06 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:15:07.849662 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:07.850264 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:07.858018 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:07.858465 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:07.859220 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:07.859649 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:08.078111 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.policy [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54fce865bd6842c19583b3bfe607fc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e436feb329204699a78d749db135acce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117494) authorize /opt/stack/nova/nova/policy.py:199}} May 24 14:15:08.085542 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-4ee4b1ec-8f73-4267-91ba-259eb9e0fd01 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 200 len: 1673 microversion: 2.1 time: 0.239686 May 24 14:15:08.086112 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 554/1103] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:15:07 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 14:15:08.480034 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-2dcb3477-70c7-432c-a7ab-9ecf9fa626f4 req-dfa6206b-3418-4cdb-a71b-014cd9d9f377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9954418b-cb4d-4071-878e-c2c7fb37d5d2", "name": "network-vif-deleted", "tag": "7c859bac-238c-4f9a-90d0-1f20a8c84b95"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 14:15:08.489337 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-2dcb3477-70c7-432c-a7ab-9ecf9fa626f4 req-dfa6206b-3418-4cdb-a71b-014cd9d9f377 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:08.489884 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-2dcb3477-70c7-432c-a7ab-9ecf9fa626f4 req-dfa6206b-3418-4cdb-a71b-014cd9d9f377 service nova] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:08.515411 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-2dcb3477-70c7-432c-a7ab-9ecf9fa626f4 req-dfa6206b-3418-4cdb-a71b-014cd9d9f377 service nova] Creating event network-vif-deleted:7c859bac-238c-4f9a-90d0-1f20a8c84b95 for instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 on hv-cinder-84212 May 24 14:15:08.522037 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-2dcb3477-70c7-432c-a7ab-9ecf9fa626f4 req-dfa6206b-3418-4cdb-a71b-014cd9d9f377 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045963 May 24 14:15:08.522636 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 550/1104] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 24 14:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 14:15:09.103587 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:09.104359 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:09.111419 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:09.111896 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:09.112671 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:09.113104 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:09.127709 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] HTTP exception thrown: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Request method failure captured: May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 HTTP/1.1 May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOaqIYDdRHB6M4fBFNIc7DavaokyOxblJRdWk9qngUAmAcs7c317OsTOY4NPoXdrApk3uMT5mGp8dj8kowXQ4UaP1J0DmCwXg9BW3b6Tl8X430_uxMR1unVI3ASt_RmzoX1KhcM_bfRkjneE0AqCsNLjBCS9sC4M-A4cssXCJH-I46k May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: e436feb329204699a78d749db135acce May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:15:09.129372 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e436feb329204699a78d749db135acce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e436feb329204699a78d749db135acce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: e436feb329204699a78d749db135acce May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 54fce865bd6842c19583b3bfe607fc32 May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:09.131174 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '9954418b-cb4d-4071-878e-c2c7fb37d5d2'} May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:15:09.132871 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:09.135644 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:09.138357 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Returning 404 to user: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:15:09.138357 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-71e62331-1aca-4897-a278-7a152e39836a tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 404 len: 111 microversion: 2.1 time: 0.031368 May 24 14:15:09.138357 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 555/1105] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:15:09 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:15:09.140683 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-06f4e18d-e53a-488b-9839-f3e1eb2ea52f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '.version_select at 0x7f33b5874dc0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:09.159686 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-06f4e18d-e53a-488b-9839-f3e1eb2ea52f tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301748315" status: 202 len: 0 microversion: 2.1 time: 0.023359 May 24 14:15:09.160330 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 551/1106] 10.222.0.24 () {58 vars in 1217 bytes} [Tue May 24 14:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301748315 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 14:15:12.055204 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:12.055704 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:12.062865 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:12.063313 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:12.064107 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:12.064545 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:12.078417 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] HTTP exception thrown: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Request method failure captured: May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 HTTP/1.1 May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOaqIYDdRHB6M4fBFNIc7DavaokyOxblJRdWk9qngUAmAcs7c317OsTOY4NPoXdrApk3uMT5mGp8dj8kowXQ4UaP1J0DmCwXg9BW3b6Tl8X430_uxMR1unVI3ASt_RmzoX1KhcM_bfRkjneE0AqCsNLjBCS9sC4M-A4cssXCJH-I46k May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: e436feb329204699a78d749db135acce May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:15:12.079975 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e436feb329204699a78d749db135acce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e436feb329204699a78d749db135acce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: e436feb329204699a78d749db135acce May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 54fce865bd6842c19583b3bfe607fc32 May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.081663 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': '9954418b-cb4d-4071-878e-c2c7fb37d5d2'} May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:15:12.082828 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.084467 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:12.086237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Returning 404 to user: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:15:12.086237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-001310d7-9c01-46ba-a7ed-07d2aa056982 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 404 len: 111 microversion: 2.1 time: 0.030060 May 24 14:15:12.086237 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 556/1107] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:15:12 2022] DELETE /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:15:12.090887 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:12.091618 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: 9954418b-cb4d-4071-878e-c2c7fb37d5d2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:12.097783 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:12.098249 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:12.099017 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:12.099465 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:12.113055 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] HTTP exception thrown: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Request method failure captured: May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 HTTP/1.1 May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOaqIYDdRHB6M4fBFNIc7DavaokyOxblJRdWk9qngUAmAcs7c317OsTOY4NPoXdrApk3uMT5mGp8dj8kowXQ4UaP1J0DmCwXg9BW3b6Tl8X430_uxMR1unVI3ASt_RmzoX1KhcM_bfRkjneE0AqCsNLjBCS9sC4M-A4cssXCJH-I46k May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: e436feb329204699a78d749db135acce May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:15:12.114654 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e436feb329204699a78d749db135acce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e436feb329204699a78d749db135acce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: e436feb329204699a78d749db135acce May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 54fce865bd6842c19583b3bfe607fc32 May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.116415 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '9954418b-cb4d-4071-878e-c2c7fb37d5d2'} May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:15:12.117310 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. May 24 14:15:12.118669 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:12.119885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Returning 404 to user: Instance 9954418b-cb4d-4071-878e-c2c7fb37d5d2 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:15:12.119885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9388fe8f-19d7-4b5d-bb7b-06f7485d7fe0 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2" status: 404 len: 111 microversion: 2.1 time: 0.030127 May 24 14:15:12.119885 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 552/1108] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:15:12 2022] GET /compute/v2.1/servers/9954418b-cb4d-4071-878e-c2c7fb37d5d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:15:13.252515 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:13.253024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.compute.api [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117494) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:13.259806 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:13.260295 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:13.261144 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:13.261722 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG oslo_concurrency.lockutils [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117494) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:13.274800 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.wsgi [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] HTTP exception thrown: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Request method failure captured: May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: request: DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad HTTP/1.1 May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept: application/json May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Accept-Encoding: identity May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Connection: close May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Length: 0 May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Content-Type: application/json May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Host: 10.222.0.24 May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Openstack-System-Scope: None May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: User-Agent: python-urllib3/1.26.9 May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Auth-Token: gAAAAABijOaqIYDdRHB6M4fBFNIc7DavaokyOxblJRdWk9qngUAmAcs7c317OsTOY4NPoXdrApk3uMT5mGp8dj8kowXQ4UaP1J0DmCwXg9BW3b6Tl8X430_uxMR1unVI3ASt_RmzoX1KhcM_bfRkjneE0AqCsNLjBCS9sC4M-A4cssXCJH-I46k May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Id: None May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Domain-Name: None May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Identity-Status: Confirmed May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Is-Admin-Project: True May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Id: default May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Domain-Name: Default May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Id: e436feb329204699a78d749db135acce May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Project-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Role: reader,member May 24 14:15:13.276354 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Roles: reader,member May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e436feb329204699a78d749db135acce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e436feb329204699a78d749db135acce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Id: e436feb329204699a78d749db135acce May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Id: default May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Domain-Name: Default May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Id: 54fce865bd6842c19583b3bfe607fc32 May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: X-User-Name: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: method: > May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: exception: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.278136 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: action_args: {'id': 'a98d1fc5-59b2-4360-ab1b-8154005f26ad'} May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: {{(pid=117494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:15:13.279314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.280929 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: ERROR nova.api.openstack.wsgi May 24 14:15:13.282683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: DEBUG nova.api.openstack.wsgi [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Returning 404 to user: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. {{(pid=117494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:15:13.282683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO nova.api.openstack.requestlog [None req-5a58a0e2-d060-45b2-84a6-cb7dd08bfd94 tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 404 len: 111 microversion: 2.1 time: 0.029363 May 24 14:15:13.282683 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: [pid: 117494|app: 0|req: 557/1109] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 24 14:15:13 2022] DELETE /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:15:13.286252 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 14:15:13.286898 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] [instance: a98d1fc5-59b2-4360-ab1b-8154005f26ad] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 14:15:13.293925 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:13.294373 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:13.295129 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 14:15:13.295565 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Lock "d750e084-f072-4f5c-be8b-4cec57d0cd04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 14:15:13.309321 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] HTTP exception thrown: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Request method failure captured: May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad HTTP/1.1 May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Connection: close May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.24 May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABijOaqIYDdRHB6M4fBFNIc7DavaokyOxblJRdWk9qngUAmAcs7c317OsTOY4NPoXdrApk3uMT5mGp8dj8kowXQ4UaP1J0DmCwXg9BW3b6Tl8X430_uxMR1unVI3ASt_RmzoX1KhcM_bfRkjneE0AqCsNLjBCS9sC4M-A4cssXCJH-I46k May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Id: e436feb329204699a78d749db135acce May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 24 14:15:13.310810 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.24:8080", "publicURL": "http://10.222.0.24:8080/v1/AUTH_e436feb329204699a78d749db135acce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/e436feb329204699a78d749db135acce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/e436feb329204699a78d749db135acce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: e436feb329204699a78d749db135acce May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419866723 May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Id: 54fce865bd6842c19583b3bfe607fc32 May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeTestJSON-419866723-project May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: method: > May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: exception: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.312562 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'a98d1fc5-59b2-4360-ab1b-8154005f26ad'} May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 14:15:13.313738 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. May 24 14:15:13.315371 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 24 14:15:13.317308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] Returning 404 to user: Instance a98d1fc5-59b2-4360-ab1b-8154005f26ad could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 14:15:13.317308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3a74dc1c-c358-41c6-91f5-052aeec1a15e tempest-AttachVolumeTestJSON-419866723 tempest-AttachVolumeTestJSON-419866723-project] 10.222.0.24 "GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad" status: 404 len: 111 microversion: 2.1 time: 0.029829 May 24 14:15:13.317308 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 553/1110] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 24 14:15:13 2022] GET /compute/v2.1/servers/a98d1fc5-59b2-4360-ab1b-8154005f26ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 14:15:53.315328 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:15:53.316025 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:15:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:17:19.591654 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:17:19.592225 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:17:44.365230 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:17:44.365937 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:17:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:19:04.115314 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:19:04.116024 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:19:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:19:13.323688 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:19:13.324334 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:20:22.042118 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:20:22.042901 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:20:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:20:39.601222 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:20:39.601815 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:20:55.660830 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:20:55.661353 dv-cinder-842129-1-iscsi devstack@n-api.service[117493]: Tue May 24 14:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 14:21:04.373155 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 14:21:04.373754 dv-cinder-842129-1-iscsi devstack@n-api.service[117494]: Tue May 24 14:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!